-- Logs begin at Fri 2021-08-27 03:52:57 UTC, end at Fri 2021-08-27 04:59:24 UTC. -- Aug 27 04:22:02.440294 dv-cinder-804035-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 27 04:22:02.449226 dv-cinder-804035-5-iscsi devstack@n-api.service[93134]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 27 04:22:02.450665 dv-cinder-804035-5-iscsi devstack@n-api.service[93134]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 27 04:22:02 2021] *** Aug 27 04:22:02.450665 dv-cinder-804035-5-iscsi devstack@n-api.service[93134]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 27 04:22:02.450665 dv-cinder-804035-5-iscsi devstack@n-api.service[93134]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 27 04:22:02.450665 dv-cinder-804035-5-iscsi devstack@n-api.service[93134]: nodename: dv-cinder-804035-5-iscsi Aug 27 04:22:02.450665 dv-cinder-804035-5-iscsi devstack@n-api.service[93134]: machine: x86_64 Aug 27 04:22:02.450665 dv-cinder-804035-5-iscsi devstack@n-api.service[93134]: clock source: unix Aug 27 04:22:02.450665 dv-cinder-804035-5-iscsi devstack@n-api.service[93134]: pcre jit disabled Aug 27 04:22:02.450665 dv-cinder-804035-5-iscsi devstack@n-api.service[93134]: detected number of CPU cores: 4 Aug 27 04:22:02.450665 dv-cinder-804035-5-iscsi devstack@n-api.service[93134]: current working directory: / Aug 27 04:22:02.450665 dv-cinder-804035-5-iscsi devstack@n-api.service[93134]: detected binary path: /usr/bin/uwsgi-core Aug 27 04:22:02.451357 dv-cinder-804035-5-iscsi devstack@n-api.service[93134]: your processes number limit is 47680 Aug 27 04:22:02.451357 dv-cinder-804035-5-iscsi devstack@n-api.service[93134]: your memory page size is 4096 bytes Aug 27 04:22:02.451357 dv-cinder-804035-5-iscsi devstack@n-api.service[93134]: detected max file descriptor number: 2048 Aug 27 04:22:02.451357 dv-cinder-804035-5-iscsi devstack@n-api.service[93134]: lock engine: pthread robust mutexes Aug 27 04:22:02.451357 dv-cinder-804035-5-iscsi devstack@n-api.service[93134]: thunder lock: enabled Aug 27 04:22:02.451357 dv-cinder-804035-5-iscsi devstack@n-api.service[93134]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 27 04:22:02.451357 dv-cinder-804035-5-iscsi devstack@n-api.service[93134]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Aug 27 04:22:02.495228 dv-cinder-804035-5-iscsi devstack@n-api.service[93134]: Python main interpreter initialized at 0x5586666ba9c0 Aug 27 04:22:02.495228 dv-cinder-804035-5-iscsi devstack@n-api.service[93134]: python threads support enabled Aug 27 04:22:02.495228 dv-cinder-804035-5-iscsi devstack@n-api.service[93134]: your server socket listen backlog is limited to 100 connections Aug 27 04:22:02.495228 dv-cinder-804035-5-iscsi devstack@n-api.service[93134]: your mercy for graceful operations on workers is 90 seconds Aug 27 04:22:02.495536 dv-cinder-804035-5-iscsi devstack@n-api.service[93134]: mapped 403077 bytes (393 KB) for 2 cores Aug 27 04:22:02.495639 dv-cinder-804035-5-iscsi devstack@n-api.service[93134]: *** Operational MODE: preforking *** Aug 27 04:22:02.495904 dv-cinder-804035-5-iscsi devstack@n-api.service[93134]: *** uWSGI is running in multiple interpreter mode *** Aug 27 04:22:02.495904 dv-cinder-804035-5-iscsi devstack@n-api.service[93134]: spawned uWSGI master process (pid: 93134) Aug 27 04:22:02.496105 dv-cinder-804035-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 27 04:22:02.497453 dv-cinder-804035-5-iscsi devstack@n-api.service[93134]: spawned uWSGI worker 1 (pid: 93135, cores: 1) Aug 27 04:22:02.497453 dv-cinder-804035-5-iscsi devstack@n-api.service[93134]: spawned uWSGI worker 2 (pid: 93136, cores: 1) Aug 27 04:22:02.497453 dv-cinder-804035-5-iscsi devstack@n-api.service[93134]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 27 04:22:04.125668 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 04:22:04.125668 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: from cryptography.utils import int_from_bytes Aug 27 04:22:04.126330 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 04:22:04.126330 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: from cryptography.utils import int_from_bytes Aug 27 04:22:04.127591 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 04:22:04.127591 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: from cryptography.utils import int_from_bytes Aug 27 04:22:04.128399 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 04:22:04.128399 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: from cryptography.utils import int_from_bytes Aug 27 04:22:06.820328 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 04:22:06.820843 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 04:22:06.821040 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 04:22:06.821395 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 04:22:06.821647 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 04:22:06.821736 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 04:22:06.822082 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 04:22:06.822163 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.822342 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.822432 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 04:22:06.822657 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.822797 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 04:22:06.822976 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.823073 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 04:22:06.823304 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.823429 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.823610 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.823765 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.823926 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.824736 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.824827 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.825016 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.825125 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.825195 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.825275 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.825343 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.825414 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.825480 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.825669 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804035-5-iscsi {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.825777 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.825962 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.826055 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.826229 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.826316 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.826547 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.826642 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.826862 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.826957 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804035-5-iscsi {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.827163 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.827256 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.827475 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.827585 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.827778 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.827876 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.828692 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.829007 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.829129 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.829353 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.829586 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.829728 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.830026 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.830152 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.830457 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.830621 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.830773 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.830951 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.831077 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.831414 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.831504 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.831788 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.831880 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.832121 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.832345 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.832442 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.832742 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.832838 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.833067 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.833239 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.833378 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.833707 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.833803 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804035-5-iscsi {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.834086 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.834318 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804035-5-iscsi {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.834465 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.834646 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.834944 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.835032 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.835262 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.835586 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.835717 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.835969 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.836101 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.836300 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.836563 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.836659 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.836925 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.837063 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.837231 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.837553 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.837640 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.837872 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.838031 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.838187 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.838501 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.838598 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.838801 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.839018 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.839107 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.839394 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.839490 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.839708 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.840011 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.840114 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.840316 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.840499 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.840596 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.840854 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.840951 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.841170 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.841467 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.841557 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.841793 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.841999 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.842088 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.842277 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.842463 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.842593 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.842908 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.843010 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.843215 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.843319 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.843529 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.844338 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.844465 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.844774 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.844862 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.845080 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.845324 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.845418 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.845670 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.845823 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.845986 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.846212 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.846354 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.846568 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.846705 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.846884 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.847071 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.847219 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.847485 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.847629 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.847873 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.53 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.848079 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.848179 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.53 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.848438 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.848545 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.848770 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.848969 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.849068 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.849372 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.849461 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.849686 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.849905 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.849993 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.850289 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.850390 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.850595 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.850832 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.850923 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.851195 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.851292 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.851513 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.851770 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.851859 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.852065 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.852282 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.852385 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.852653 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.852755 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.852964 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.853234 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.853323 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.853559 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.853721 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.853859 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.854153 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.854339 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.53 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.854435 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.854730 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.53 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.854831 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.855028 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.855208 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.855328 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.855628 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.855725 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.855930 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.856245 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.856338 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.856543 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.856726 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.856841 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.857153 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.857241 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.857466 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.857696 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.857802 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.858054 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.858171 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.858352 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.858644 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.858738 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.858956 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.859103 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.859282 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.859582 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.859668 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.859896 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.860134 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.860225 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.860506 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.860602 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.860819 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.861051 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.861148 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.861409 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.861593 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.861720 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.862014 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.862155 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.862314 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.862626 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.862712 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.862925 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.863228 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.863323 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.863526 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.863789 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.863877 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.864133 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.864366 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.864471 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.864715 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.864899 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.865010 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.865302 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.865436 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.865614 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.865929 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.866016 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.866229 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.866529 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.866617 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.866826 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.867095 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.867189 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.867456 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.867613 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.868020 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.868334 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.868654 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.868740 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.868971 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.869072 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.869300 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.869392 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.869628 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.869719 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.869943 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.870031 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.870257 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.870354 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.870567 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.870655 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.870874 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.870964 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.871197 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.871301 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.871507 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.871594 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.871813 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.871900 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.872147 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.872241 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.872464 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.872553 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.872776 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.872865 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.873098 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.873190 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.873410 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.873505 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.873719 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.873807 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.874033 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.874125 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.874344 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.874431 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.874655 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.874755 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.875019 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.875115 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.875330 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.875420 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.875639 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.875736 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.875944 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.876053 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.876276 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.876367 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.876584 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.876686 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.876892 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.876981 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.877388 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.877483 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.877964 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.878167 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.878309 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.878535 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.878731 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.879039 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.879135 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.879397 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.879569 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.879706 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.879893 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.880042 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.880235 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.880360 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.880550 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.880675 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.880875 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:22:06.880999 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.881222 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.881320 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.881561 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.881650 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.881859 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.881945 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.882167 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.882257 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.882467 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.882562 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.882783 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.882872 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.883109 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.883205 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.883412 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.883501 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.883747 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.883843 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.884072 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.884165 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.884389 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.884477 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.884731 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.884996 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.885095 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.885301 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.885396 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.885610 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.885698 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.885919 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.886009 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.886220 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.886314 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.886540 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.886631 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.886848 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.886938 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.887150 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.887238 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.887470 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.887559 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.887773 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.887869 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.888102 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.888194 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.888416 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.888504 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.888724 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.888815 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.889031 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.889128 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.889337 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.889433 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.889657 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.889747 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.889964 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.890059 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.890268 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.890364 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.891109 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.891198 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.891440 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.891529 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.891743 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.891841 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.892088 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.892189 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.892410 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.892497 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.892723 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.892828 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.893025 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.893115 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.893334 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.893432 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.893631 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.893728 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.893931 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.894020 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.894232 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.894328 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.894540 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.894629 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.894838 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.894928 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.895144 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.895232 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.895447 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.895538 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.895747 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.895835 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.896071 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.896236 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.896394 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.896701 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.896820 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.897001 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.897300 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.897386 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.897600 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.897855 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.897944 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.898224 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.898397 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.898564 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.898896 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.898998 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.899210 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.899408 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.899528 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.899839 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.899939 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.900177 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.900436 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.900525 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.900778 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.900953 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.901084 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.901390 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.901480 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.901705 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.901926 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.902028 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.902314 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.902445 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.902620 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.902931 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.903021 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.903236 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.903426 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.903552 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.903851 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.903939 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.904190 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.904439 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.904536 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.904841 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.904928 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.905160 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.905426 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.905515 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.905770 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.905943 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.906203 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.906945 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.907045 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.907252 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.907480 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.907576 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.907851 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.908034 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.908189 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.908496 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.908584 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.908810 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.909053 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.909143 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.909421 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.909572 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.909766 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.910034 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.910133 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.910332 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.910592 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.910681 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.910950 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.911082 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.911277 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.911580 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.911670 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.911885 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.912092 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.912231 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.912536 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.912641 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.912901 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.913048 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.913211 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.913512 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.913598 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.913813 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.914017 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.914105 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.914419 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.914507 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.914723 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.914979 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.915080 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.915323 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.915469 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.915633 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.915938 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.916066 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.916265 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.916484 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.916575 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.916865 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.917018 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.917171 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.917448 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.917597 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.917780 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.917917 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.918098 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.918402 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.918536 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.918702 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.918947 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.919086 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.919313 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.919452 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.919601 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.919899 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.920085 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.920229 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.920503 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.920642 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.920846 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.921013 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.921159 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.921448 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.921536 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.921805 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.922042 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.922131 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.922409 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.922549 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.922717 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.923024 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.923111 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.923342 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.923525 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.923654 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.923959 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.924075 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.924290 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.924545 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.924633 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.924890 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.925062 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.925211 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.925533 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.925619 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.925841 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.926036 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.926210 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.926521 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.926608 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.926827 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.927042 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.927132 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.927438 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.927531 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.928026 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.928121 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.928360 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.928526 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.928672 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.928991 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.929079 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.929309 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.929574 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.929673 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.929940 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.930095 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.930265 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.930594 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.930685 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.930921 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.931098 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.931335 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.931424 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.931746 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.931837 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.932094 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.932185 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.932418 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.932627 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.932734 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.933046 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.933134 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.933373 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.933519 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.933692 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.933972 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.934070 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.934378 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.934472 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.934714 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.934850 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.935032 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.935276 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.935366 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.935656 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.935758 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.935978 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.936201 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.936334 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.936675 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.936768 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.937041 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.937174 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.937455 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.937553 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.937764 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.938054 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.938149 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.938385 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.938541 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.938689 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.938992 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.939078 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.939296 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.939499 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.939636 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.939941 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.940089 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.940304 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.940485 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.940631 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.940973 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.941069 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.941279 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.941463 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.941585 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.941908 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.942005 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.942211 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.942426 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.942514 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.942798 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.942897 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.943103 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.943387 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.943475 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.943699 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.943925 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.944060 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.944351 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.944439 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.944740 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.944827 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.945067 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.945399 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.945489 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.945720 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.945863 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.946053 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.946342 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.946439 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.946685 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.946808 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.947044 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.947271 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.947379 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.947682 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.947770 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.948008 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.948131 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.948323 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.948593 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.948683 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.948973 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.949061 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.949291 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.949537 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.949634 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.949882 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.950102 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.950190 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.950489 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.950605 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.950806 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.951096 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.951185 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.951400 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.951584 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.951702 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.952031 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.952123 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.952342 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.952580 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.952681 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.953474 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.953613 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.953785 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.954091 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.954195 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.954399 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.954585 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.954699 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.955002 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.955089 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.955310 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.955556 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.955656 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.955936 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.956061 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.956263 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.956555 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.956644 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.956860 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.957116 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.957205 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.957450 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.957636 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.957846 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.957966 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.958262 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.958351 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.958594 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.958682 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.958916 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.959106 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.959243 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.959566 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.959822 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.960055 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.960220 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.960534 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.960624 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.960872 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.961005 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.961202 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.961370 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.961529 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.961823 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.961912 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.962193 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.962281 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.962516 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.962795 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.962893 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.963162 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.963284 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.963526 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.963760 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.963850 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.964165 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.964257 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.964490 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.964742 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.964832 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.965103 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.965228 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.965424 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.965708 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.965809 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.966030 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.966190 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.966340 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.966651 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.966739 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.966956 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.967135 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.967259 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.967579 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.967678 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.967886 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.968110 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.968201 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.968543 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.969231 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.969393 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.969643 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.969740 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.970008 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.970163 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.970323 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.970631 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.970735 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.970988 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.971100 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.971414 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.971512 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.971739 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.971838 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.972081 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.972295 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.972396 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.972699 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.972804 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.973057 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.973230 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.973376 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.973701 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.973792 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.974098 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.974186 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.974451 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.974548 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.974767 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.974976 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.975088 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.975429 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.975529 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.975742 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.975900 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.976075 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.976391 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.976513 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.976708 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.977003 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.977092 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.977314 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.977489 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.977644 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.977919 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.978006 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.978223 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.978437 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.978671 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.978928 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.979019 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.979284 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.979416 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.979591 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.979900 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.980031 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.980236 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.980413 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.980556 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.980870 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.980959 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.981175 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.981367 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.981592 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.981865 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.981962 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.982201 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.982354 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.982510 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.982814 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.982901 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.983117 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.983373 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.983463 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.983735 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.983874 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.984065 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.984400 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.984500 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.984859 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.984971 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.985208 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.985299 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.985528 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.985626 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.985855 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.985943 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.986170 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.986301 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.986483 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.986614 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.986796 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.986917 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.987116 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.987332 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.987430 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.987645 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.987778 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.987955 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.988078 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.988301 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.988403 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.988621 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.988711 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.988943 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.989038 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.989246 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.989344 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.989560 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.989649 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.989870 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.989960 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.990191 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.990291 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.990516 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.990627 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.990825 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.990934 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.991139 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.991253 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.991440 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.991538 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.991747 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.991844 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.992088 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.992200 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.992402 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.992495 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.992721 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.992811 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.993102 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.993199 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.993417 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.993513 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.993727 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.993834 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.994036 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.994128 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.994362 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.994467 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.994666 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.994757 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.994970 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.995068 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.995279 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.995368 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.995585 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.995680 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.995886 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.995974 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.996230 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.996320 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.996536 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.996638 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.996845 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.996934 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.997154 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.997243 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.997462 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.997625 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.997764 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.997853 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.998064 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.998160 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.998381 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.998479 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.998683 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.998780 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.999007 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.999117 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.999319 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.999430 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.999639 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.999739 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:06.999980 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.000117 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.000304 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.000403 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.000624 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.000718 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.000935 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.001034 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.001236 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.001328 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.001537 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.001629 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.001838 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.001936 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.002180 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.002271 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.002483 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.002580 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.003062 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.003151 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.003381 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.003472 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.003698 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.003795 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.004019 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.004125 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.004345 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.004450 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.004665 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.004766 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.004975 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.005077 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.005292 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.005382 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.005607 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.005696 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.005911 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.006009 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.006213 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.006301 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.006523 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.006612 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.006824 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.006931 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.007126 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.007236 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.007428 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.007532 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.007732 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.007857 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.008057 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.008170 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.008361 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.008450 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.008664 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.008755 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.008977 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.009086 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.009278 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.009367 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.009600 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.009728 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.009907 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.010044 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.010209 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.010362 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.010512 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.010673 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.010843 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.011002 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.011151 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.011292 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.011437 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.011598 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.011762 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.011910 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.012079 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.012237 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.012392 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.012672 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.012771 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.012990 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.013086 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.013305 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.013401 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.013619 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.013717 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.013927 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.014057 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.014237 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.014333 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.014545 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.014634 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.014858 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.014957 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.015169 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.015258 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.016026 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.016124 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.016329 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.016417 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.016644 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.016746 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.016956 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.017046 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.017271 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.017374 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.017698 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.017804 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.018019 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.018128 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.018332 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.018440 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.018699 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.018807 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.019009 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.019109 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.019321 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.019420 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.019631 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.019745 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.019938 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.020080 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.020270 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.020361 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.020578 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.020677 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.020885 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.020976 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.021209 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.021316 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.021527 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.021627 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.021849 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.021941 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.022166 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.022262 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.022481 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.022572 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.022790 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.022879 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.023101 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.023189 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.023413 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.023505 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.023739 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.023828 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.024088 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.024196 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.024394 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.024513 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.024706 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.024849 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.025002 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.025154 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.025318 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.025479 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.025618 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.025818 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.025960 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.026131 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.026278 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.026445 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.026594 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.026763 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.026902 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.027074 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.027215 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.027385 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.027534 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.027748 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.027896 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.028077 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.028211 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.028336 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.028433 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.028651 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.028750 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.028956 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.029045 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.029264 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.029360 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.029576 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.029719 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.029904 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.030090 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.030214 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.030404 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.030542 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.030735 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.030863 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.031105 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.031753 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.031919 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.032108 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.032269 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.032422 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.032586 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.032756 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.032911 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.033073 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.033215 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.033385 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.033518 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.033695 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.033828 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.034006 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.034135 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.034354 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.034444 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.034665 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.034755 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.034993 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.035084 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.035326 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.035421 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.035643 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.035733 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.035956 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.036077 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.036318 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.036506 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.036653 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.036852 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.036977 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.037167 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.037302 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.037488 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.037634 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.037810 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.037943 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.038187 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.038288 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.038430 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.038557 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.038752 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.038866 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.039057 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.039175 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.039360 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.039484 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.039673 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.039797 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.039981 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.040127 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.040305 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.040434 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.040606 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.040745 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.040915 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.041089 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.041227 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.041384 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.041509 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.041712 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.041801 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.042027 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.042141 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.042338 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.042429 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.042652 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.042748 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.042963 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.043060 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.043278 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.043368 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.043585 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.043675 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.043933 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.044282 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.044609 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.044698 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.044945 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.045034 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.045265 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.045366 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.045593 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.045688 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.045919 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.046015 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.046237 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.046400 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.046560 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.046651 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.046923 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.047021 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.047245 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.047341 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.047555 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.047644 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.047869 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.048093 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.048204 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.048363 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.048524 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.048615 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.048828 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.048916 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.049136 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.049226 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.049451 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.049669 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.049760 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.050005 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.050102 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.050328 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.050418 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.050648 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.050738 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.050969 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.051067 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.051290 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.051379 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.051609 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.051828 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.051918 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.052185 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.052277 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.052522 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.052613 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.052863 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.052961 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.053199 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.053287 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.053503 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.053591 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.053810 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.053971 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.054116 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.054206 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.054437 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.054526 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.054750 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.054853 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.055061 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.055150 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.055372 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.055464 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.055680 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.055796 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.056024 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.056118 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.056330 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.056422 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.056641 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.056733 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.056950 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.057040 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.057258 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.057349 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.057567 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.057658 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.057875 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.057965 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.058200 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.058300 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.058518 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.058623 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.058831 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.058927 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.059143 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.059241 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.059456 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.059551 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.059765 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.059861 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.060099 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.060206 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.060410 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.060507 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.060717 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.060814 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.061032 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.061128 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.061360 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.061451 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.061674 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.061764 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.061980 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.062199 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.062418 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.062548 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.062733 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.062890 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.063049 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.063221 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.063367 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.063555 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.063677 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.063880 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.064026 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.064235 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.064570 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.064667 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.064884 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.064987 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.065198 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.065288 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.065515 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.065613 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.065837 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.066006 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.066147 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.066245 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.066475 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.066564 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.066792 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.066891 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.067103 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.067193 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.067413 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.067502 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.067718 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.067819 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.068059 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.068280 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.068383 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.068632 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.068732 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.068953 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.069043 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.069282 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.069373 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.069611 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.069707 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.069920 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.070010 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.070229 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.070317 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.070596 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.070700 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.070858 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.070947 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.071166 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.071253 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.071483 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.071585 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.071793 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.071881 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.072125 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.072216 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.072436 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.072527 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.072746 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.072841 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.073055 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.073145 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.073360 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.073449 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.073675 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.073765 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.073983 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.074073 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.074288 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.074378 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.074610 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.074698 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.074918 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.075008 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.075224 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.075321 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.075535 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.075624 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.075845 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.076199 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.076507 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.076658 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.076823 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.076982 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.077132 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.077301 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.077443 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.077619 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.077758 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.078464 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.078595 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.078783 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.078920 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.079103 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.079244 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.079415 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.079569 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.079736 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.079894 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.080068 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.080264 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.080389 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.080581 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.080700 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.080924 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.081015 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.081250 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.081340 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.081492 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 04:22:07.081621 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.081927 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.082244 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.082571 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.082888 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.083205 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.083558 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.083881 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.084450 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.084795 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.085141 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.085488 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.085841 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.086154 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.086465 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.086776 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.087106 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.087424 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.087741 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.088084 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.088402 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.088719 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.089036 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.089351 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.089666 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.089979 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.090294 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.090607 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.090950 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.091274 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.091615 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.091922 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.092266 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.092581 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.092895 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.093207 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.093543 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.094396 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.094732 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.095053 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.095363 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.095795 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.096134 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.096464 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.096787 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.097104 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.097431 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.097758 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.098077 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.098404 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.098724 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.099248 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.099504 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.099845 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.100296 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.100509 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.100821 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.101133 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.101452 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.101791 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.102112 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.102440 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.102761 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.103089 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.103406 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.103734 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.104083 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.104409 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.104507 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG oslo_db.sqlalchemy.engines [None req-0f083361-2c73-4d07-bed2-9203f72cb0f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93135) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 04:22:07.104728 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.105066 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.105384 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.105710 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.106026 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.106341 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.106658 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.106972 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.107306 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.107637 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.107948 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.108300 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.108624 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.108951 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.109304 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.109623 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.109956 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.110267 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.110587 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.110903 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.111218 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.111540 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.111862 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.112215 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.112548 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.112878 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.113207 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.113560 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.113884 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.114238 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.114573 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:22:07.114821 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 04:22:07.136792 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG oslo_db.sqlalchemy.engines [None req-d7a5d461-63d9-4479-ba41-674001154b2d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93136) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 04:22:07.179885 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.context [None req-0f083361-2c73-4d07-bed2-9203f72cb0f8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3f04f680-d87c-48d8-b9f0-21b73fb7deea(cell1) {{(pid=93135) load_cells /opt/stack/nova/nova/context.py:464}} Aug 27 04:22:07.184107 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG oslo_concurrency.lockutils [None req-0f083361-2c73-4d07-bed2-9203f72cb0f8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:07.185697 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG oslo_concurrency.lockutils [None req-0f083361-2c73-4d07-bed2-9203f72cb0f8 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:07.186492 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG oslo_concurrency.lockutils [None req-0f083361-2c73-4d07-bed2-9203f72cb0f8 None None] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:07.188970 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG oslo_concurrency.lockutils [None req-0f083361-2c73-4d07-bed2-9203f72cb0f8 None None] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:07.200969 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG oslo_db.sqlalchemy.engines [None req-0f083361-2c73-4d07-bed2-9203f72cb0f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93135) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 04:22:07.203808 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG oslo_db.sqlalchemy.engines [None req-0f083361-2c73-4d07-bed2-9203f72cb0f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93135) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 04:22:07.213709 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.context [None req-d7a5d461-63d9-4479-ba41-674001154b2d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3f04f680-d87c-48d8-b9f0-21b73fb7deea(cell1) {{(pid=93136) load_cells /opt/stack/nova/nova/context.py:464}} Aug 27 04:22:07.218149 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG oslo_concurrency.lockutils [None req-d7a5d461-63d9-4479-ba41-674001154b2d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:07.219864 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG oslo_concurrency.lockutils [None req-d7a5d461-63d9-4479-ba41-674001154b2d None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:07.220746 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG oslo_concurrency.lockutils [None req-d7a5d461-63d9-4479-ba41-674001154b2d None None] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:07.222775 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG oslo_concurrency.lockutils [None req-d7a5d461-63d9-4479-ba41-674001154b2d None None] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:07.237566 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG oslo_db.sqlalchemy.engines [None req-d7a5d461-63d9-4479-ba41-674001154b2d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93136) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 04:22:07.239957 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG oslo_db.sqlalchemy.engines [None req-d7a5d461-63d9-4479-ba41-674001154b2d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93136) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 04:22:07.553807 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG oslo_db.sqlalchemy.engines [None req-0f083361-2c73-4d07-bed2-9203f72cb0f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93135) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 04:22:07.600483 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG oslo_db.sqlalchemy.engines [None req-d7a5d461-63d9-4479-ba41-674001154b2d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93136) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 04:22:07.894174 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: WARNING keystonemiddleware.auth_token [None req-0f083361-2c73-4d07-bed2-9203f72cb0f8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 04:22:07.900573 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: WARNING keystonemiddleware.auth_token [None req-0f083361-2c73-4d07-bed2-9203f72cb0f8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 04:22:07.922100 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: WARNING keystonemiddleware.auth_token [None req-d7a5d461-63d9-4479-ba41-674001154b2d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 04:22:07.928701 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: WARNING keystonemiddleware.auth_token [None req-d7a5d461-63d9-4479-ba41-674001154b2d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 04:22:08.243372 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: WARNING keystonemiddleware.auth_token [None req-0f083361-2c73-4d07-bed2-9203f72cb0f8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 04:22:08.248497 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: WARNING keystonemiddleware.auth_token [None req-0f083361-2c73-4d07-bed2-9203f72cb0f8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 04:22:08.253897 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5586666ba9c0 pid: 93135 (default app) Aug 27 04:22:08.256021 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi [None req-0f083361-2c73-4d07-bed2-9203f72cb0f8 None None] Calling method '>' {{(pid=93135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:22:08.257210 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: INFO nova.api.openstack.requestlog [None req-0f083361-2c73-4d07-bed2-9203f72cb0f8 None None] 10.222.0.53 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001770 Aug 27 04:22:08.257619 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: [pid: 93135|app: 0|req: 1/1] 10.222.0.53 () {50 vars in 789 bytes} [Fri Aug 27 04:22:08 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:22:08.272670 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: WARNING keystonemiddleware.auth_token [None req-d7a5d461-63d9-4479-ba41-674001154b2d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 04:22:08.277815 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: WARNING keystonemiddleware.auth_token [None req-d7a5d461-63d9-4479-ba41-674001154b2d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 04:22:08.283657 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5586666ba9c0 pid: 93136 (default app) Aug 27 04:23:27.857109 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi [None req-0f083361-2c73-4d07-bed2-9203f72cb0f8 None None] Calling method '>' {{(pid=93135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:27.858108 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: INFO nova.api.openstack.requestlog [None req-0f083361-2c73-4d07-bed2-9203f72cb0f8 None None] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001964 Aug 27 04:23:27.858511 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: [pid: 93135|app: 0|req: 2/2] 10.222.0.53 () {54 vars in 931 bytes} [Fri Aug 27 04:23:27 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:23:28.280687 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi [None req-abe17584-1e60-4513-903b-2c53b91b822c admin admin] Calling method '>' {{(pid=93136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:28.309565 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: INFO nova.api.openstack.requestlog [None req-abe17584-1e60-4513-903b-2c53b91b822c admin admin] 10.222.0.53 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.443730 Aug 27 04:23:28.310225 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: [pid: 93136|app: 0|req: 1/3] 10.222.0.53 () {60 vars in 1292 bytes} [Fri Aug 27 04:23:27 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:23:30.533528 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi [None req-0f083361-2c73-4d07-bed2-9203f72cb0f8 None None] Calling method '>' {{(pid=93135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:30.534526 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: INFO nova.api.openstack.requestlog [None req-0f083361-2c73-4d07-bed2-9203f72cb0f8 None None] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001660 Aug 27 04:23:30.534932 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: [pid: 93135|app: 0|req: 3/4] 10.222.0.53 () {54 vars in 931 bytes} [Fri Aug 27 04:23:30 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:23:30.593566 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi [None req-b487d548-c18c-47df-8cca-b79483d1ff29 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "rxtx_factor": 1.0, "ram": 256, "vcpus": 1, "id": "c1", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "cirros256"}} {{(pid=93136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:23:30.611960 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:23:30.611960 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: warnings.warn(msg) Aug 27 04:23:30.640465 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: INFO nova.api.openstack.requestlog [None req-b487d548-c18c-47df-8cca-b79483d1ff29 admin admin] 10.222.0.53 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.098888 Aug 27 04:23:30.641206 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: [pid: 93136|app: 0|req: 2/5] 10.222.0.53 () {64 vars in 1283 bytes} [Fri Aug 27 04:23:30 2021] POST /compute/v2.1/flavors => generated 407 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:23:30.864588 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi [None req-9c43ded0-c006-4f14-b2ff-2b5783191548 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:23:30.866826 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:23:30.866826 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: warnings.warn(msg) Aug 27 04:23:30.916963 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: INFO nova.api.openstack.requestlog [None req-9c43ded0-c006-4f14-b2ff-2b5783191548 admin admin] 10.222.0.53 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.267329 Aug 27 04:23:30.917748 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: [pid: 93135|app: 0|req: 4/6] 10.222.0.53 () {64 vars in 1336 bytes} [Fri Aug 27 04:23:30 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:23:33.116768 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi [None req-b487d548-c18c-47df-8cca-b79483d1ff29 admin admin] Calling method '>' {{(pid=93136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:33.117793 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: INFO nova.api.openstack.requestlog [None req-b487d548-c18c-47df-8cca-b79483d1ff29 admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Aug 27 04:23:33.118360 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: [pid: 93136|app: 0|req: 3/7] 10.222.0.53 () {54 vars in 931 bytes} [Fri Aug 27 04:23:33 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:23:33.242115 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi [None req-ed34379b-508d-4158-b310-dcc2a73446c0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds512M", "vcpus": 1, "ram": 512, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d1"}} {{(pid=93135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:23:33.261474 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:23:33.261474 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: warnings.warn(msg) Aug 27 04:23:33.283815 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: INFO nova.api.openstack.requestlog [None req-ed34379b-508d-4158-b310-dcc2a73446c0 admin admin] 10.222.0.53 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.159156 Aug 27 04:23:33.284721 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: [pid: 93135|app: 0|req: 5/8] 10.222.0.53 () {64 vars in 1283 bytes} [Fri Aug 27 04:23:33 2021] POST /compute/v2.1/flavors => generated 404 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:23:33.297728 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi [None req-a44c03fa-da73-43f2-806e-7bd44a48ed2e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:23:33.299509 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:23:33.299509 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: warnings.warn(msg) Aug 27 04:23:33.335138 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: INFO nova.api.openstack.requestlog [None req-a44c03fa-da73-43f2-806e-7bd44a48ed2e admin admin] 10.222.0.53 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042056 Aug 27 04:23:33.344408 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: [pid: 93136|app: 0|req: 4/9] 10.222.0.53 () {64 vars in 1336 bytes} [Fri Aug 27 04:23:33 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:23:35.532539 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi [None req-ed34379b-508d-4158-b310-dcc2a73446c0 admin admin] Calling method '>' {{(pid=93135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:35.533564 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: INFO nova.api.openstack.requestlog [None req-ed34379b-508d-4158-b310-dcc2a73446c0 admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 27 04:23:35.533963 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: [pid: 93135|app: 0|req: 6/10] 10.222.0.53 () {54 vars in 931 bytes} [Fri Aug 27 04:23:35 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:23:35.593846 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi [None req-575397d1-93dc-4c17-bff6-e00895e649f2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "disk": 10, "name": "ds1G", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=93136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:23:35.614452 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: INFO nova.api.openstack.requestlog [None req-575397d1-93dc-4c17-bff6-e00895e649f2 admin admin] 10.222.0.53 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074011 Aug 27 04:23:35.615144 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: [pid: 93136|app: 0|req: 5/11] 10.222.0.53 () {64 vars in 1283 bytes} [Fri Aug 27 04:23:35 2021] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:23:35.630683 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi [None req-ec4f4396-0481-4fe5-83ee-94362973f0a2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:23:35.663528 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: INFO nova.api.openstack.requestlog [None req-ec4f4396-0481-4fe5-83ee-94362973f0a2 admin admin] 10.222.0.53 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037571 Aug 27 04:23:35.665316 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: [pid: 93135|app: 0|req: 7/12] 10.222.0.53 () {64 vars in 1336 bytes} [Fri Aug 27 04:23:35 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:23:37.889427 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi [None req-575397d1-93dc-4c17-bff6-e00895e649f2 admin admin] Calling method '>' {{(pid=93136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:37.890412 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: INFO nova.api.openstack.requestlog [None req-575397d1-93dc-4c17-bff6-e00895e649f2 admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Aug 27 04:23:37.891085 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: [pid: 93136|app: 0|req: 6/13] 10.222.0.53 () {54 vars in 931 bytes} [Fri Aug 27 04:23:37 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:23:37.958087 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi [None req-e166f184-f702-4898-b361-b42cab4a09cf admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "rxtx_factor": 1.0, "swap": 0, "ram": 2048, "name": "ds2G", "vcpus": 2}} {{(pid=93135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:23:37.980295 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: INFO nova.api.openstack.requestlog [None req-e166f184-f702-4898-b361-b42cab4a09cf admin admin] 10.222.0.53 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.082863 Aug 27 04:23:37.981617 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: [pid: 93135|app: 0|req: 8/14] 10.222.0.53 () {64 vars in 1283 bytes} [Fri Aug 27 04:23:37 2021] POST /compute/v2.1/flavors => generated 404 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:23:37.993845 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi [None req-beb1546c-231a-4cdb-aca7-8a82b055ceea admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:23:38.016037 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: INFO nova.api.openstack.requestlog [None req-beb1546c-231a-4cdb-aca7-8a82b055ceea admin admin] 10.222.0.53 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025812 Aug 27 04:23:38.016608 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: [pid: 93136|app: 0|req: 7/15] 10.222.0.53 () {64 vars in 1336 bytes} [Fri Aug 27 04:23:37 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:23:40.331566 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi [None req-e166f184-f702-4898-b361-b42cab4a09cf admin admin] Calling method '>' {{(pid=93135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:40.332646 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: INFO nova.api.openstack.requestlog [None req-e166f184-f702-4898-b361-b42cab4a09cf admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Aug 27 04:23:40.333046 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: [pid: 93135|app: 0|req: 9/16] 10.222.0.53 () {54 vars in 931 bytes} [Fri Aug 27 04:23:40 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:23:40.401828 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi [None req-e2e20625-931b-4959-8229-bb02141a6626 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "id": "d4", "vcpus": 4, "swap": 0}} {{(pid=93136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:23:40.422430 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: INFO nova.api.openstack.requestlog [None req-e2e20625-931b-4959-8229-bb02141a6626 admin admin] 10.222.0.53 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.082494 Aug 27 04:23:40.423095 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: [pid: 93136|app: 0|req: 8/17] 10.222.0.53 () {64 vars in 1283 bytes} [Fri Aug 27 04:23:40 2021] POST /compute/v2.1/flavors => generated 404 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:23:40.435689 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi [None req-da677c4c-b185-4da1-ac06-4a4fb2c90e97 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:23:40.461128 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: INFO nova.api.openstack.requestlog [None req-da677c4c-b185-4da1-ac06-4a4fb2c90e97 admin admin] 10.222.0.53 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029196 Aug 27 04:23:40.462056 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: [pid: 93135|app: 0|req: 10/18] 10.222.0.53 () {64 vars in 1336 bytes} [Fri Aug 27 04:23:40 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:23:42.906922 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi [None req-e2e20625-931b-4959-8229-bb02141a6626 admin admin] Calling method '>' {{(pid=93136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:42.908206 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: INFO nova.api.openstack.requestlog [None req-e2e20625-931b-4959-8229-bb02141a6626 admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001802 Aug 27 04:23:42.912698 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: [pid: 93136|app: 0|req: 9/19] 10.222.0.53 () {54 vars in 931 bytes} [Fri Aug 27 04:23:42 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:23:42.994736 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi [None req-c29db446-3811-4863-8645-1294c06ffdc0 admin admin] Calling method '>' {{(pid=93135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:43.018513 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: INFO nova.api.openstack.requestlog [None req-c29db446-3811-4863-8645-1294c06ffdc0 admin admin] 10.222.0.53 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.101831 Aug 27 04:23:43.019071 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: [pid: 93135|app: 0|req: 11/20] 10.222.0.53 () {60 vars in 1292 bytes} [Fri Aug 27 04:23:42 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:23:45.561522 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi [None req-e2e20625-931b-4959-8229-bb02141a6626 admin admin] Calling method '>' {{(pid=93136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:45.562543 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: INFO nova.api.openstack.requestlog [None req-e2e20625-931b-4959-8229-bb02141a6626 admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 27 04:23:45.562944 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: [pid: 93136|app: 0|req: 10/21] 10.222.0.53 () {54 vars in 931 bytes} [Fri Aug 27 04:23:45 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:23:45.635601 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi [None req-449a7e72-8a15-49cd-ae4e-290e43fa17fd admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "vcpus": 1, "name": "m1.tiny", "rxtx_factor": 1.0, "id": "1", "swap": 0, "os-flavor-access:is_public": true, "ram": 512}} {{(pid=93135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:23:45.657273 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: INFO nova.api.openstack.requestlog [None req-449a7e72-8a15-49cd-ae4e-290e43fa17fd admin admin] 10.222.0.53 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.087527 Aug 27 04:23:45.657863 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: [pid: 93135|app: 0|req: 12/22] 10.222.0.53 () {64 vars in 1283 bytes} [Fri Aug 27 04:23:45 2021] POST /compute/v2.1/flavors => generated 402 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:23:45.671235 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi [None req-7c5be57a-59ad-46d5-b5a3-7c3475ecedb4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:23:45.694083 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: INFO nova.api.openstack.requestlog [None req-7c5be57a-59ad-46d5-b5a3-7c3475ecedb4 admin admin] 10.222.0.53 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027173 Aug 27 04:23:45.694629 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: [pid: 93136|app: 0|req: 11/23] 10.222.0.53 () {64 vars in 1333 bytes} [Fri Aug 27 04:23:45 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:23:48.406801 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi [None req-449a7e72-8a15-49cd-ae4e-290e43fa17fd admin admin] Calling method '>' {{(pid=93135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:48.407829 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: INFO nova.api.openstack.requestlog [None req-449a7e72-8a15-49cd-ae4e-290e43fa17fd admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Aug 27 04:23:48.408593 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: [pid: 93135|app: 0|req: 13/24] 10.222.0.53 () {54 vars in 931 bytes} [Fri Aug 27 04:23:48 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:23:48.480732 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi [None req-ce65f247-90a7-4857-81f2-1b174a608716 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "name": "m1.small", "disk": 20}} {{(pid=93136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:23:48.522844 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: INFO nova.api.openstack.requestlog [None req-ce65f247-90a7-4857-81f2-1b174a608716 admin admin] 10.222.0.53 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.106010 Aug 27 04:23:48.524540 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: [pid: 93136|app: 0|req: 12/25] 10.222.0.53 () {64 vars in 1283 bytes} [Fri Aug 27 04:23:48 2021] POST /compute/v2.1/flavors => generated 405 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:23:48.537697 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi [None req-8e24fcfe-3716-45b5-92a3-6c89dc2792de admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:23:48.563876 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: INFO nova.api.openstack.requestlog [None req-8e24fcfe-3716-45b5-92a3-6c89dc2792de admin admin] 10.222.0.53 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029836 Aug 27 04:23:48.564558 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: [pid: 93135|app: 0|req: 14/26] 10.222.0.53 () {64 vars in 1333 bytes} [Fri Aug 27 04:23:48 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:23:51.365274 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi [None req-ce65f247-90a7-4857-81f2-1b174a608716 admin admin] Calling method '>' {{(pid=93136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:51.366282 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: INFO nova.api.openstack.requestlog [None req-ce65f247-90a7-4857-81f2-1b174a608716 admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Aug 27 04:23:51.367327 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: [pid: 93136|app: 0|req: 13/27] 10.222.0.53 () {54 vars in 931 bytes} [Fri Aug 27 04:23:51 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:23:51.425812 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi [None req-d52e8ce9-0c63-42d0-a915-e042b6169d4c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "name": "m1.medium", "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "rxtx_factor": 1.0, "disk": 40, "vcpus": 2}} {{(pid=93135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:23:51.447118 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: INFO nova.api.openstack.requestlog [None req-d52e8ce9-0c63-42d0-a915-e042b6169d4c admin admin] 10.222.0.53 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.071946 Aug 27 04:23:51.447220 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: [pid: 93135|app: 0|req: 15/28] 10.222.0.53 () {64 vars in 1283 bytes} [Fri Aug 27 04:23:51 2021] POST /compute/v2.1/flavors => generated 406 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:23:51.459275 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi [None req-2b472a4d-80ee-49e9-8849-deca21df601a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:23:51.484246 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: INFO nova.api.openstack.requestlog [None req-2b472a4d-80ee-49e9-8849-deca21df601a admin admin] 10.222.0.53 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028465 Aug 27 04:23:51.484833 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: [pid: 93136|app: 0|req: 14/29] 10.222.0.53 () {64 vars in 1333 bytes} [Fri Aug 27 04:23:51 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:23:53.748672 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi [None req-d52e8ce9-0c63-42d0-a915-e042b6169d4c admin admin] Calling method '>' {{(pid=93135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:53.750498 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: INFO nova.api.openstack.requestlog [None req-d52e8ce9-0c63-42d0-a915-e042b6169d4c admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002359 Aug 27 04:23:53.750893 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: [pid: 93135|app: 0|req: 16/30] 10.222.0.53 () {54 vars in 931 bytes} [Fri Aug 27 04:23:53 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:23:53.820338 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi [None req-982a56e7-daaa-4541-b317-bbfcd4e6e651 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "id": "4", "rxtx_factor": 1.0, "ram": 8192, "os-flavor-access:is_public": true, "vcpus": 4, "swap": 0, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=93136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:23:53.838988 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: INFO nova.api.openstack.requestlog [None req-982a56e7-daaa-4541-b317-bbfcd4e6e651 admin admin] 10.222.0.53 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.081679 Aug 27 04:23:53.840195 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: [pid: 93136|app: 0|req: 15/31] 10.222.0.53 () {64 vars in 1283 bytes} [Fri Aug 27 04:23:53 2021] POST /compute/v2.1/flavors => generated 405 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:23:53.852057 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi [None req-50f1cbbc-bc83-45f4-a858-3d02d4cc58f6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:23:53.878713 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: INFO nova.api.openstack.requestlog [None req-50f1cbbc-bc83-45f4-a858-3d02d4cc58f6 admin admin] 10.222.0.53 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030208 Aug 27 04:23:53.879563 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: [pid: 93135|app: 0|req: 17/32] 10.222.0.53 () {64 vars in 1333 bytes} [Fri Aug 27 04:23:53 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:23:56.526745 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi [None req-982a56e7-daaa-4541-b317-bbfcd4e6e651 admin admin] Calling method '>' {{(pid=93136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:56.527768 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: INFO nova.api.openstack.requestlog [None req-982a56e7-daaa-4541-b317-bbfcd4e6e651 admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Aug 27 04:23:56.534079 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: [pid: 93136|app: 0|req: 16/33] 10.222.0.53 () {54 vars in 931 bytes} [Fri Aug 27 04:23:56 2021] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:23:56.596058 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi [None req-48c0a639-f3a9-43b6-924d-b17b0999f6ee admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "rxtx_factor": 1.0, "name": "m1.xlarge", "id": "5", "ram": 16384, "vcpus": 8}} {{(pid=93135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:23:56.617055 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: INFO nova.api.openstack.requestlog [None req-48c0a639-f3a9-43b6-924d-b17b0999f6ee admin admin] 10.222.0.53 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.081522 Aug 27 04:23:56.617991 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: [pid: 93135|app: 0|req: 18/34] 10.222.0.53 () {64 vars in 1283 bytes} [Fri Aug 27 04:23:56 2021] POST /compute/v2.1/flavors => generated 408 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:23:56.630975 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi [None req-53f5610d-8cb3-40c8-a9a0-7bc6f95d230e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:23:56.665921 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: INFO nova.api.openstack.requestlog [None req-53f5610d-8cb3-40c8-a9a0-7bc6f95d230e admin admin] 10.222.0.53 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038494 Aug 27 04:23:56.666912 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: [pid: 93136|app: 0|req: 17/35] 10.222.0.53 () {64 vars in 1333 bytes} [Fri Aug 27 04:23:56 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:24:35.140931 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi [None req-48c0a639-f3a9-43b6-924d-b17b0999f6ee admin admin] Calling method '>' {{(pid=93135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:35.141943 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: INFO nova.api.openstack.requestlog [None req-48c0a639-f3a9-43b6-924d-b17b0999f6ee admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Aug 27 04:24:35.142342 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: [pid: 93135|app: 0|req: 19/36] 10.222.0.53 () {54 vars in 931 bytes} [Fri Aug 27 04:24:35 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:24:35.202592 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi [None req-eaa5c229-d34d-4202-962e-f87870218cd6 admin admin] Calling method '>' {{(pid=93136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:35.219388 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: INFO nova.api.openstack.requestlog [None req-eaa5c229-d34d-4202-962e-f87870218cd6 admin admin] 10.222.0.53 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070036 Aug 27 04:24:35.219927 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: [pid: 93136|app: 0|req: 18/37] 10.222.0.53 () {60 vars in 1292 bytes} [Fri Aug 27 04:24:35 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:24:36.689143 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi [None req-48c0a639-f3a9-43b6-924d-b17b0999f6ee admin admin] Calling method '>' {{(pid=93135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:36.690142 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: INFO nova.api.openstack.requestlog [None req-48c0a639-f3a9-43b6-924d-b17b0999f6ee admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Aug 27 04:24:36.690534 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: [pid: 93135|app: 0|req: 20/38] 10.222.0.53 () {56 vars in 1075 bytes} [Fri Aug 27 04:24:36 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:24:36.886895 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi [None req-01b4e96c-f4e3-4782-8e07-8698ee72906d admin admin] Calling method '>' {{(pid=93136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:36.892340 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: INFO nova.api.openstack.wsgi [None req-01b4e96c-f4e3-4782-8e07-8698ee72906d admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 27 04:24:36.892907 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi [None req-01b4e96c-f4e3-4782-8e07-8698ee72906d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=93136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:24:36.893764 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: INFO nova.api.openstack.requestlog [None req-01b4e96c-f4e3-4782-8e07-8698ee72906d admin admin] 10.222.0.53 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.062283 Aug 27 04:24:36.894228 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: [pid: 93136|app: 0|req: 19/39] 10.222.0.53 () {60 vars in 1191 bytes} [Fri Aug 27 04:24:36 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 27 04:24:36.904384 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi [None req-e1e2dd5e-94e5-4d02-88e0-dd9416da8d7f admin admin] Calling method '>' {{(pid=93135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:36.925952 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: INFO nova.api.openstack.requestlog [None req-e1e2dd5e-94e5-4d02-88e0-dd9416da8d7f admin admin] 10.222.0.53 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.025321 Aug 27 04:24:36.926514 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: [pid: 93135|app: 0|req: 21/40] 10.222.0.53 () {60 vars in 1211 bytes} [Fri Aug 27 04:24:36 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:24:36.937070 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi [None req-42420964-c421-418f-b329-7bca9864cda5 admin admin] Calling method '>' {{(pid=93136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:36.959415 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: INFO nova.api.openstack.requestlog [None req-42420964-c421-418f-b329-7bca9864cda5 admin admin] 10.222.0.53 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.025880 Aug 27 04:24:36.959970 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: [pid: 93136|app: 0|req: 20/41] 10.222.0.53 () {60 vars in 1211 bytes} [Fri Aug 27 04:24:36 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:24:36.970616 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi [None req-335528bf-4317-46ae-90e5-e02e9d9ad0a0 admin admin] Calling method '>' {{(pid=93135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:36.976205 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: INFO nova.api.openstack.wsgi [None req-335528bf-4317-46ae-90e5-e02e9d9ad0a0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 27 04:24:36.976772 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi [None req-335528bf-4317-46ae-90e5-e02e9d9ad0a0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=93135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:24:36.977561 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: INFO nova.api.openstack.requestlog [None req-335528bf-4317-46ae-90e5-e02e9d9ad0a0 admin admin] 10.222.0.53 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.010585 Aug 27 04:24:36.978060 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: [pid: 93135|app: 0|req: 22/42] 10.222.0.53 () {60 vars in 1191 bytes} [Fri Aug 27 04:24:36 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 27 04:24:38.361332 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi [None req-42420964-c421-418f-b329-7bca9864cda5 admin admin] Calling method '>' {{(pid=93136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:38.362610 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: INFO nova.api.openstack.requestlog [None req-42420964-c421-418f-b329-7bca9864cda5 admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001540 Aug 27 04:24:38.363180 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: [pid: 93136|app: 0|req: 21/43] 10.222.0.53 () {56 vars in 1075 bytes} [Fri Aug 27 04:24:38 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:24:38.556999 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi [None req-97a67b17-725b-4b93-86fd-1c2b5b533fec admin admin] Calling method '>' {{(pid=93135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:38.563252 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: INFO nova.api.openstack.wsgi [None req-97a67b17-725b-4b93-86fd-1c2b5b533fec admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 27 04:24:38.563735 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi [None req-97a67b17-725b-4b93-86fd-1c2b5b533fec admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=93135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:24:38.564543 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: INFO nova.api.openstack.requestlog [None req-97a67b17-725b-4b93-86fd-1c2b5b533fec admin admin] 10.222.0.53 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.062431 Aug 27 04:24:38.565057 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: [pid: 93135|app: 0|req: 23/44] 10.222.0.53 () {60 vars in 1191 bytes} [Fri Aug 27 04:24:38 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 27 04:24:38.576386 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi [None req-eae89f6e-1ca8-4d7c-8351-65e6e5b7ef7d admin admin] Calling method '>' {{(pid=93136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:38.591829 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: INFO nova.api.openstack.requestlog [None req-eae89f6e-1ca8-4d7c-8351-65e6e5b7ef7d admin admin] 10.222.0.53 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.019702 Aug 27 04:24:38.592505 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: [pid: 93136|app: 0|req: 22/45] 10.222.0.53 () {60 vars in 1211 bytes} [Fri Aug 27 04:24:38 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:24:38.603617 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi [None req-fa3f4768-827a-45d2-ba37-3d55b6f7e88e admin admin] Calling method '>' {{(pid=93135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:38.618409 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: INFO nova.api.openstack.requestlog [None req-fa3f4768-827a-45d2-ba37-3d55b6f7e88e admin admin] 10.222.0.53 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.018470 Aug 27 04:24:38.618975 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: [pid: 93135|app: 0|req: 24/46] 10.222.0.53 () {60 vars in 1211 bytes} [Fri Aug 27 04:24:38 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:24:38.629980 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi [None req-d18f927e-d4ec-4fcc-a47f-2129393aa657 admin admin] Calling method '>' {{(pid=93136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:38.635334 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: INFO nova.api.openstack.wsgi [None req-d18f927e-d4ec-4fcc-a47f-2129393aa657 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 27 04:24:38.635894 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi [None req-d18f927e-d4ec-4fcc-a47f-2129393aa657 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=93136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:24:38.636712 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: INFO nova.api.openstack.requestlog [None req-d18f927e-d4ec-4fcc-a47f-2129393aa657 admin admin] 10.222.0.53 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.010343 Aug 27 04:24:38.637223 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: [pid: 93136|app: 0|req: 23/47] 10.222.0.53 () {60 vars in 1191 bytes} [Fri Aug 27 04:24:38 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 27 04:24:40.028439 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi [None req-fa3f4768-827a-45d2-ba37-3d55b6f7e88e admin admin] Calling method '>' {{(pid=93135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:40.029960 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: INFO nova.api.openstack.requestlog [None req-fa3f4768-827a-45d2-ba37-3d55b6f7e88e admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001770 Aug 27 04:24:40.030547 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: [pid: 93135|app: 0|req: 25/48] 10.222.0.53 () {56 vars in 1075 bytes} [Fri Aug 27 04:24:40 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:24:40.255283 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi [None req-e37c03fc-aa7c-49bd-babb-203a4473a978 admin admin] Calling method '>' {{(pid=93136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:40.261843 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: INFO nova.api.openstack.wsgi [None req-e37c03fc-aa7c-49bd-babb-203a4473a978 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 27 04:24:40.262411 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi [None req-e37c03fc-aa7c-49bd-babb-203a4473a978 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=93136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:24:40.263208 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: INFO nova.api.openstack.requestlog [None req-e37c03fc-aa7c-49bd-babb-203a4473a978 admin admin] 10.222.0.53 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.059904 Aug 27 04:24:40.263721 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: [pid: 93136|app: 0|req: 24/49] 10.222.0.53 () {60 vars in 1194 bytes} [Fri Aug 27 04:24:40 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 27 04:24:40.273754 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi [None req-eded6dcf-2b72-442d-89b8-259628363b00 admin admin] Calling method '>' {{(pid=93135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:40.287866 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: INFO nova.api.openstack.requestlog [None req-eded6dcf-2b72-442d-89b8-259628363b00 admin admin] 10.222.0.53 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017849 Aug 27 04:24:40.288473 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: [pid: 93135|app: 0|req: 26/50] 10.222.0.53 () {60 vars in 1211 bytes} [Fri Aug 27 04:24:40 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:24:40.300425 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi [None req-8c97f109-d55b-42b9-ae14-f75860f96ea4 admin admin] Calling method '>' {{(pid=93136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:40.315278 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: INFO nova.api.openstack.requestlog [None req-8c97f109-d55b-42b9-ae14-f75860f96ea4 admin admin] 10.222.0.53 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.018494 Aug 27 04:24:40.316821 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: [pid: 93136|app: 0|req: 25/51] 10.222.0.53 () {60 vars in 1211 bytes} [Fri Aug 27 04:24:40 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:24:40.328276 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi [None req-32b225a0-2705-41c7-84df-bbbdfef52ac1 admin admin] Calling method '>' {{(pid=93135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:40.334925 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: INFO nova.api.openstack.wsgi [None req-32b225a0-2705-41c7-84df-bbbdfef52ac1 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 27 04:24:40.335980 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi [None req-32b225a0-2705-41c7-84df-bbbdfef52ac1 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=93135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:24:40.337355 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: INFO nova.api.openstack.requestlog [None req-32b225a0-2705-41c7-84df-bbbdfef52ac1 admin admin] 10.222.0.53 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.014468 Aug 27 04:24:40.337983 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: [pid: 93135|app: 0|req: 27/52] 10.222.0.53 () {60 vars in 1194 bytes} [Fri Aug 27 04:24:40 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 27 04:24:41.731676 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi [None req-8c97f109-d55b-42b9-ae14-f75860f96ea4 admin admin] Calling method '>' {{(pid=93136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:41.732722 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: INFO nova.api.openstack.requestlog [None req-8c97f109-d55b-42b9-ae14-f75860f96ea4 admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001734 Aug 27 04:24:41.733114 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: [pid: 93136|app: 0|req: 26/53] 10.222.0.53 () {56 vars in 1075 bytes} [Fri Aug 27 04:24:41 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:24:41.930654 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi [None req-9d900f9d-fefe-4a7f-81df-f2daf6231d97 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:24:41.950175 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: INFO nova.api.openstack.requestlog [None req-9d900f9d-fefe-4a7f-81df-f2daf6231d97 admin admin] 10.222.0.53 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.88 time: 0.074636 Aug 27 04:24:41.950634 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: [pid: 93135|app: 0|req: 28/54] 10.222.0.53 () {64 vars in 1236 bytes} [Fri Aug 27 04:24:41 2021] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:24:43.484690 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi [None req-8c97f109-d55b-42b9-ae14-f75860f96ea4 admin admin] Calling method '>' {{(pid=93136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:43.486542 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: INFO nova.api.openstack.requestlog [None req-8c97f109-d55b-42b9-ae14-f75860f96ea4 admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004748 Aug 27 04:24:43.486952 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: [pid: 93136|app: 0|req: 27/55] 10.222.0.53 () {56 vars in 1075 bytes} [Fri Aug 27 04:24:43 2021] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:24:43.679702 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi [None req-36b3b253-d4c7-4b8f-a661-306afea2043c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:24:43.697722 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: INFO nova.api.openstack.requestlog [None req-36b3b253-d4c7-4b8f-a661-306afea2043c admin admin] 10.222.0.53 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.88 time: 0.069798 Aug 27 04:24:43.698288 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: [pid: 93135|app: 0|req: 29/56] 10.222.0.53 () {64 vars in 1236 bytes} [Fri Aug 27 04:24:43 2021] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:24:45.066250 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi [None req-8c97f109-d55b-42b9-ae14-f75860f96ea4 admin admin] Calling method '>' {{(pid=93136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:45.067246 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: INFO nova.api.openstack.requestlog [None req-8c97f109-d55b-42b9-ae14-f75860f96ea4 admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Aug 27 04:24:45.067629 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: [pid: 93136|app: 0|req: 28/57] 10.222.0.53 () {56 vars in 1075 bytes} [Fri Aug 27 04:24:45 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:24:45.260600 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi [None req-3d6e887c-1d60-40db-bca4-068486b223c9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:24:45.279705 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: INFO nova.api.openstack.requestlog [None req-3d6e887c-1d60-40db-bca4-068486b223c9 admin admin] 10.222.0.53 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.88 time: 0.071591 Aug 27 04:24:45.280226 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: [pid: 93135|app: 0|req: 30/58] 10.222.0.53 () {64 vars in 1236 bytes} [Fri Aug 27 04:24:45 2021] POST /compute/v2.1/flavors => generated 407 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:24:46.650243 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi [None req-8c97f109-d55b-42b9-ae14-f75860f96ea4 admin admin] Calling method '>' {{(pid=93136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:46.651469 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: INFO nova.api.openstack.requestlog [None req-8c97f109-d55b-42b9-ae14-f75860f96ea4 admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002035 Aug 27 04:24:46.652072 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: [pid: 93136|app: 0|req: 29/59] 10.222.0.53 () {56 vars in 1075 bytes} [Fri Aug 27 04:24:46 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:24:46.859210 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi [None req-e762a91a-072d-4ead-bd04-aec04fca1bf8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:24:46.877183 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: INFO nova.api.openstack.requestlog [None req-e762a91a-072d-4ead-bd04-aec04fca1bf8 admin admin] 10.222.0.53 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.88 time: 0.072778 Aug 27 04:24:46.877737 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: [pid: 93135|app: 0|req: 31/60] 10.222.0.53 () {64 vars in 1236 bytes} [Fri Aug 27 04:24:46 2021] POST /compute/v2.1/flavors => generated 409 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:24:48.322591 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi [None req-8c97f109-d55b-42b9-ae14-f75860f96ea4 admin admin] Calling method '>' {{(pid=93136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:48.323609 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: INFO nova.api.openstack.requestlog [None req-8c97f109-d55b-42b9-ae14-f75860f96ea4 admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Aug 27 04:24:48.324027 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: [pid: 93136|app: 0|req: 30/61] 10.222.0.53 () {56 vars in 1075 bytes} [Fri Aug 27 04:24:48 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:24:48.527658 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi [None req-12075eb4-53a6-453c-a2ef-df7fdc3654b8 admin admin] Calling method '>' {{(pid=93135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:48.552764 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: INFO nova.api.openstack.requestlog [None req-12075eb4-53a6-453c-a2ef-df7fdc3654b8 admin admin] 10.222.0.53 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.085384 Aug 27 04:24:48.553447 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: [pid: 93135|app: 0|req: 32/62] 10.222.0.53 () {60 vars in 1203 bytes} [Fri Aug 27 04:24:48 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:25:34.485825 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi [None req-8c97f109-d55b-42b9-ae14-f75860f96ea4 admin admin] Calling method '>' {{(pid=93136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:25:34.486789 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: INFO nova.api.openstack.requestlog [None req-8c97f109-d55b-42b9-ae14-f75860f96ea4 admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Aug 27 04:25:34.487187 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: [pid: 93136|app: 0|req: 31/63] 10.222.0.53 () {54 vars in 931 bytes} [Fri Aug 27 04:25:34 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:25:34.547239 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi [None req-80658e67-08d9-4f2a-936e-e373b734d326 admin admin] Calling method '>' {{(pid=93135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:25:34.566840 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: INFO nova.api.openstack.requestlog [None req-80658e67-08d9-4f2a-936e-e373b734d326 admin admin] 10.222.0.53 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.073052 Aug 27 04:25:34.567366 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: [pid: 93135|app: 0|req: 33/64] 10.222.0.53 () {60 vars in 1292 bytes} [Fri Aug 27 04:25:34 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:25:34.590343 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi [None req-73f5b427-587d-487d-9e5d-461f5313764d admin admin] Calling method '>' {{(pid=93136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:25:34.598042 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: INFO nova.api.openstack.requestlog [None req-73f5b427-587d-487d-9e5d-461f5313764d admin admin] 10.222.0.53 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011319 Aug 27 04:25:34.598567 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: [pid: 93136|app: 0|req: 32/65] 10.222.0.53 () {60 vars in 1283 bytes} [Fri Aug 27 04:25:34 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:25:34.611060 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi [None req-c18cbb4b-7f8f-45ff-bee0-25e83f635463 admin admin] Calling method '>' {{(pid=93135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:25:34.618765 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: INFO nova.api.openstack.requestlog [None req-c18cbb4b-7f8f-45ff-bee0-25e83f635463 admin admin] 10.222.0.53 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011138 Aug 27 04:25:34.619982 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: [pid: 93135|app: 0|req: 34/66] 10.222.0.53 () {60 vars in 1286 bytes} [Fri Aug 27 04:25:34 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:25:34.631291 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi [None req-aead337c-f182-4466-93d1-d0bd77777531 admin admin] Calling method '>' {{(pid=93136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:25:34.638842 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: INFO nova.api.openstack.requestlog [None req-aead337c-f182-4466-93d1-d0bd77777531 admin admin] 10.222.0.53 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010989 Aug 27 04:25:34.639350 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: [pid: 93136|app: 0|req: 33/67] 10.222.0.53 () {60 vars in 1286 bytes} [Fri Aug 27 04:25:34 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:25:34.650594 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi [None req-41d70971-3b0d-4829-807e-ce26ac6d7831 admin admin] Calling method '>' {{(pid=93135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:25:34.657992 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: INFO nova.api.openstack.requestlog [None req-41d70971-3b0d-4829-807e-ce26ac6d7831 admin admin] 10.222.0.53 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010823 Aug 27 04:25:34.658497 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: [pid: 93135|app: 0|req: 35/68] 10.222.0.53 () {60 vars in 1283 bytes} [Fri Aug 27 04:25:34 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:27:25.972826 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi [None req-098b6daf-58fb-4a69-adb7-4404ed41ecfe tempest-verify_tempest_config-86199931 tempest-verify_tempest_config-86199931-project] Calling method '>' {{(pid=93136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:27:25.974792 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: INFO nova.api.openstack.requestlog [None req-098b6daf-58fb-4a69-adb7-4404ed41ecfe tempest-verify_tempest_config-86199931 tempest-verify_tempest_config-86199931-project] 10.222.0.53 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.117182 Aug 27 04:27:25.975326 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: [pid: 93136|app: 0|req: 34/69] 10.222.0.53 () {58 vars in 1134 bytes} [Fri Aug 27 04:27:25 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:28:56.864950 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi [None req-41d70971-3b0d-4829-807e-ce26ac6d7831 admin admin] Calling method '>' {{(pid=93135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:28:56.865993 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: INFO nova.api.openstack.requestlog [None req-41d70971-3b0d-4829-807e-ce26ac6d7831 admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Aug 27 04:28:56.866386 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: [pid: 93135|app: 0|req: 36/70] 10.222.0.53 () {56 vars in 1075 bytes} [Fri Aug 27 04:28:56 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:28:57.128199 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi [None req-34eb549d-a681-45ab-a5de-4204e25af636 admin admin] Calling method '>' {{(pid=93136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:28:57.129369 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:28:57.129369 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: warnings.warn(msg) Aug 27 04:28:57.131016 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG oslo_concurrency.lockutils [None req-34eb549d-a681-45ab-a5de-4204e25af636 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:28:57.131492 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG oslo_concurrency.lockutils [None req-34eb549d-a681-45ab-a5de-4204e25af636 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:28:57.132310 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG oslo_concurrency.lockutils [None req-34eb549d-a681-45ab-a5de-4204e25af636 admin admin] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:28:57.132741 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG oslo_concurrency.lockutils [None req-34eb549d-a681-45ab-a5de-4204e25af636 admin admin] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:28:57.166765 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: INFO nova.api.openstack.requestlog [None req-34eb549d-a681-45ab-a5de-4204e25af636 admin admin] 10.222.0.53 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.156709 Aug 27 04:28:57.167344 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: [pid: 93136|app: 0|req: 35/71] 10.222.0.53 () {60 vars in 1194 bytes} [Fri Aug 27 04:28:57 2021] GET /compute/v2.1/os-services => generated 791 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:28:58.556059 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi [None req-41d70971-3b0d-4829-807e-ce26ac6d7831 admin admin] Calling method '>' {{(pid=93135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:28:58.557725 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: INFO nova.api.openstack.requestlog [None req-41d70971-3b0d-4829-807e-ce26ac6d7831 admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Aug 27 04:28:58.558132 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: [pid: 93135|app: 0|req: 37/72] 10.222.0.53 () {56 vars in 1075 bytes} [Fri Aug 27 04:28:58 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:28:58.751108 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi [None req-e822ba9f-b0a4-4ce6-899b-ea76d0c81614 admin admin] Calling method '>' {{(pid=93136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:28:58.752284 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:28:58.752284 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: warnings.warn(msg) Aug 27 04:28:58.753816 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG oslo_concurrency.lockutils [None req-e822ba9f-b0a4-4ce6-899b-ea76d0c81614 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:28:58.754256 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG oslo_concurrency.lockutils [None req-e822ba9f-b0a4-4ce6-899b-ea76d0c81614 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:28:58.755039 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG oslo_concurrency.lockutils [None req-e822ba9f-b0a4-4ce6-899b-ea76d0c81614 admin admin] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:28:58.755460 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG oslo_concurrency.lockutils [None req-e822ba9f-b0a4-4ce6-899b-ea76d0c81614 admin admin] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:28:58.774270 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: INFO nova.api.openstack.requestlog [None req-e822ba9f-b0a4-4ce6-899b-ea76d0c81614 admin admin] 10.222.0.53 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.077019 Aug 27 04:28:58.774840 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: [pid: 93136|app: 0|req: 36/73] 10.222.0.53 () {60 vars in 1194 bytes} [Fri Aug 27 04:28:58 2021] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:29:10.579633 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi [None req-41d70971-3b0d-4829-807e-ce26ac6d7831 admin admin] Calling method '>' {{(pid=93135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:29:10.580677 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: INFO nova.api.openstack.requestlog [None req-41d70971-3b0d-4829-807e-ce26ac6d7831 admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 27 04:29:10.581075 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: [pid: 93135|app: 0|req: 38/74] 10.222.0.53 () {56 vars in 1075 bytes} [Fri Aug 27 04:29:10 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:29:10.775774 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi [None req-e78ff5f5-bec3-42a5-9a4c-cebb139f78c4 admin admin] Calling method '>' {{(pid=93136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:29:10.776950 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:29:10.776950 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: warnings.warn(msg) Aug 27 04:29:10.778461 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG oslo_concurrency.lockutils [None req-e78ff5f5-bec3-42a5-9a4c-cebb139f78c4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:29:10.778900 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG oslo_concurrency.lockutils [None req-e78ff5f5-bec3-42a5-9a4c-cebb139f78c4 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:29:10.779767 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG oslo_concurrency.lockutils [None req-e78ff5f5-bec3-42a5-9a4c-cebb139f78c4 admin admin] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:29:10.780260 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG oslo_concurrency.lockutils [None req-e78ff5f5-bec3-42a5-9a4c-cebb139f78c4 admin admin] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:29:10.804139 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: INFO nova.api.openstack.requestlog [None req-e78ff5f5-bec3-42a5-9a4c-cebb139f78c4 admin admin] 10.222.0.53 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.081441 Aug 27 04:29:10.804705 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: [pid: 93136|app: 0|req: 37/75] 10.222.0.53 () {60 vars in 1194 bytes} [Fri Aug 27 04:29:10 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:29:12.176751 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: DEBUG nova.api.openstack.wsgi [None req-41d70971-3b0d-4829-807e-ce26ac6d7831 admin admin] Calling method '>' {{(pid=93135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:29:12.177784 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: INFO nova.api.openstack.requestlog [None req-41d70971-3b0d-4829-807e-ce26ac6d7831 admin admin] 10.222.0.53 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Aug 27 04:29:12.178177 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: [pid: 93135|app: 0|req: 39/76] 10.222.0.53 () {56 vars in 1075 bytes} [Fri Aug 27 04:29:12 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:29:12.387572 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG nova.api.openstack.wsgi [None req-80cec7dd-1542-419b-82eb-8fd7aef71df7 admin admin] Calling method '>' {{(pid=93136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:29:12.388869 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:29:12.388869 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: warnings.warn(msg) Aug 27 04:29:12.390379 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG oslo_concurrency.lockutils [None req-80cec7dd-1542-419b-82eb-8fd7aef71df7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:29:12.390846 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG oslo_concurrency.lockutils [None req-80cec7dd-1542-419b-82eb-8fd7aef71df7 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:29:12.391627 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG oslo_concurrency.lockutils [None req-80cec7dd-1542-419b-82eb-8fd7aef71df7 admin admin] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:29:12.392072 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: DEBUG oslo_concurrency.lockutils [None req-80cec7dd-1542-419b-82eb-8fd7aef71df7 admin admin] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:29:12.414520 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: INFO nova.api.openstack.requestlog [None req-80cec7dd-1542-419b-82eb-8fd7aef71df7 admin admin] 10.222.0.53 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.88 time: 0.083107 Aug 27 04:29:12.415089 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: [pid: 93136|app: 0|req: 38/77] 10.222.0.53 () {60 vars in 1194 bytes} [Fri Aug 27 04:29:12 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:30:10.781265 dv-cinder-804035-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 27 04:30:10.782038 dv-cinder-804035-5-iscsi devstack@n-api.service[93134]: Fri Aug 27 04:30:10 2021 - graceful shutdown triggered... Aug 27 04:30:10.782698 dv-cinder-804035-5-iscsi devstack@n-api.service[93136]: Gracefully killing worker 2 (pid: 93136)... Aug 27 04:30:10.783241 dv-cinder-804035-5-iscsi devstack@n-api.service[93135]: Gracefully killing worker 1 (pid: 93135)... Aug 27 04:30:11.784142 dv-cinder-804035-5-iscsi devstack@n-api.service[93134]: worker 1 buried after 1 seconds Aug 27 04:30:11.784714 dv-cinder-804035-5-iscsi devstack@n-api.service[93134]: worker 2 buried after 1 seconds Aug 27 04:30:11.784714 dv-cinder-804035-5-iscsi devstack@n-api.service[93134]: goodbye to uWSGI. Aug 27 04:30:11.785737 dv-cinder-804035-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 27 04:30:11.786290 dv-cinder-804035-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 27 04:30:11.789169 dv-cinder-804035-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 27 04:30:11.802966 dv-cinder-804035-5-iscsi devstack@n-api.service[108951]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 27 04:30:11.804970 dv-cinder-804035-5-iscsi devstack@n-api.service[108951]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 27 04:30:11 2021] *** Aug 27 04:30:11.804970 dv-cinder-804035-5-iscsi devstack@n-api.service[108951]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 27 04:30:11.804970 dv-cinder-804035-5-iscsi devstack@n-api.service[108951]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 27 04:30:11.804970 dv-cinder-804035-5-iscsi devstack@n-api.service[108951]: nodename: dv-cinder-804035-5-iscsi Aug 27 04:30:11.804970 dv-cinder-804035-5-iscsi devstack@n-api.service[108951]: machine: x86_64 Aug 27 04:30:11.804970 dv-cinder-804035-5-iscsi devstack@n-api.service[108951]: clock source: unix Aug 27 04:30:11.804970 dv-cinder-804035-5-iscsi devstack@n-api.service[108951]: pcre jit disabled Aug 27 04:30:11.804970 dv-cinder-804035-5-iscsi devstack@n-api.service[108951]: detected number of CPU cores: 4 Aug 27 04:30:11.804970 dv-cinder-804035-5-iscsi devstack@n-api.service[108951]: current working directory: / Aug 27 04:30:11.804970 dv-cinder-804035-5-iscsi devstack@n-api.service[108951]: detected binary path: /usr/bin/uwsgi-core Aug 27 04:30:11.804970 dv-cinder-804035-5-iscsi devstack@n-api.service[108951]: your processes number limit is 47680 Aug 27 04:30:11.804970 dv-cinder-804035-5-iscsi devstack@n-api.service[108951]: your memory page size is 4096 bytes Aug 27 04:30:11.804970 dv-cinder-804035-5-iscsi devstack@n-api.service[108951]: detected max file descriptor number: 2048 Aug 27 04:30:11.805972 dv-cinder-804035-5-iscsi devstack@n-api.service[108951]: lock engine: pthread robust mutexes Aug 27 04:30:11.805972 dv-cinder-804035-5-iscsi devstack@n-api.service[108951]: thunder lock: enabled Aug 27 04:30:11.805972 dv-cinder-804035-5-iscsi devstack@n-api.service[108951]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 27 04:30:11.805972 dv-cinder-804035-5-iscsi devstack@n-api.service[108951]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Aug 27 04:30:11.851453 dv-cinder-804035-5-iscsi devstack@n-api.service[108951]: Python main interpreter initialized at 0x559b5e6029c0 Aug 27 04:30:11.851453 dv-cinder-804035-5-iscsi devstack@n-api.service[108951]: python threads support enabled Aug 27 04:30:11.851453 dv-cinder-804035-5-iscsi devstack@n-api.service[108951]: your server socket listen backlog is limited to 100 connections Aug 27 04:30:11.851453 dv-cinder-804035-5-iscsi devstack@n-api.service[108951]: your mercy for graceful operations on workers is 90 seconds Aug 27 04:30:11.852032 dv-cinder-804035-5-iscsi devstack@n-api.service[108951]: mapped 403077 bytes (393 KB) for 2 cores Aug 27 04:30:11.852032 dv-cinder-804035-5-iscsi devstack@n-api.service[108951]: *** Operational MODE: preforking *** Aug 27 04:30:11.852204 dv-cinder-804035-5-iscsi devstack@n-api.service[108951]: *** uWSGI is running in multiple interpreter mode *** Aug 27 04:30:11.852204 dv-cinder-804035-5-iscsi devstack@n-api.service[108951]: spawned uWSGI master process (pid: 108951) Aug 27 04:30:11.852400 dv-cinder-804035-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 27 04:30:11.860014 dv-cinder-804035-5-iscsi devstack@n-api.service[108951]: spawned uWSGI worker 1 (pid: 108970, cores: 1) Aug 27 04:30:11.860014 dv-cinder-804035-5-iscsi devstack@n-api.service[108951]: spawned uWSGI worker 2 (pid: 108971, cores: 1) Aug 27 04:30:11.860014 dv-cinder-804035-5-iscsi devstack@n-api.service[108951]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 27 04:30:13.739164 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 04:30:13.739164 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: from cryptography.utils import int_from_bytes Aug 27 04:30:13.739800 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 04:30:13.739800 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: from cryptography.utils import int_from_bytes Aug 27 04:30:13.741567 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 04:30:13.741567 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: from cryptography.utils import int_from_bytes Aug 27 04:30:13.742037 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 04:30:13.742037 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: from cryptography.utils import int_from_bytes Aug 27 04:30:16.385844 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 04:30:16.386382 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 04:30:16.386624 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 04:30:16.386905 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 04:30:16.387165 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 04:30:16.387559 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.387896 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.388261 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.388575 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.388908 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.389225 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.389554 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.389875 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.389986 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 04:30:16.390363 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 04:30:16.390445 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.390445 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.390714 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 04:30:16.390811 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.391012 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 04:30:16.391125 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804035-5-iscsi {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.391273 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 04:30:16.391381 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.391664 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.391775 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.392091 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.392207 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.392376 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.392483 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.392752 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.392948 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.393041 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.393125 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.393387 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.393500 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.393584 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.393738 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.393918 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.394957 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.394957 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.395414 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.395639 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.395878 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.396139 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804035-5-iscsi {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.396390 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.396615 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.396838 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.397060 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.397282 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.397588 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.397814 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.398047 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.398275 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.398498 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.398732 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.399006 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.399224 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.399466 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.399690 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.399913 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.400198 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804035-5-iscsi {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.400510 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.400705 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.400948 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.401207 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.401359 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.401651 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.401852 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.401852 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.402157 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.402312 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.402467 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.402621 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.402778 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.402924 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.403076 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.403266 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.403441 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.403595 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.403760 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.403914 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804035-5-iscsi {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.404115 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.405282 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.405447 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.405596 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.405741 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.405968 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.406129 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.406129 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.406434 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.406594 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.406760 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.406918 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.407073 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.407228 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.407424 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.407572 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.407725 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.407879 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.408064 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.408224 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.408382 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.408538 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.408699 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.408861 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.409016 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.410263 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.411351 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.415997 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.416245 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.416410 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.416586 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.416743 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.416896 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.417540 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.417706 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.417870 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.418021 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.418167 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.418322 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.418476 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.418628 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.418799 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.418955 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.419112 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.419264 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.419427 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.419579 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.419746 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.419900 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.420084 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.420236 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.420392 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.420392 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.420691 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.420846 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.420992 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.421139 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.421283 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.421283 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.421593 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.421745 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.421892 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.422044 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.422203 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.53 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.422354 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.422514 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.53 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.422514 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.422864 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.423016 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.423179 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.423179 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.423484 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.423631 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.423785 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.423938 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.424138 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.424294 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.424452 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.424610 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.424764 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.424909 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.425742 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.426272 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.426436 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.426607 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.53 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.426763 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.426918 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.53 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.427074 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.427230 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.427379 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.427524 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.427670 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.427824 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.427978 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.428162 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.428317 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.428471 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.428634 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.428797 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.428945 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.429091 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.429243 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.429417 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.429699 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.429884 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.430046 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.430203 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.430351 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.430505 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.430652 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.430821 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.430984 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.431131 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.431277 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.431422 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.431581 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.431734 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.431881 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.432134 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.432291 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.432452 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.432610 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.433323 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.433480 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.433629 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.433775 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.433935 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.434088 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.434235 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.434388 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.434535 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.434683 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.434915 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.435073 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.435249 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.436228 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.436659 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.436819 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.436976 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.437135 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.437281 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.437442 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.437598 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.437745 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.437901 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.438054 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.438201 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.438357 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.438529 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.438684 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.438843 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.438991 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.439145 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.439303 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.439450 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.439604 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.439758 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.439907 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.440095 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.440254 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.440401 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.440570 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.440725 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.440883 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.441031 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.441177 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.441340 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.441500 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.441647 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.441793 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.441950 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.442106 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.442253 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.442408 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.442573 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.442720 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.442866 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.443018 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.443171 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.443335 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.443482 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.443636 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.443783 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.443930 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.444229 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.444409 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.444757 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.444912 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.445059 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.446051 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.446411 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.446848 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.447013 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.447170 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.447320 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.447477 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.447623 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.447770 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.447915 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.448099 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.448277 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.448277 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.448578 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.448738 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.448896 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.449049 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.449196 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.449352 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.449498 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.449643 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.449789 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.449935 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:30:16.450099 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.450247 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.450394 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.450538 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.450691 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.450691 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.450980 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.451133 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.451286 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.451451 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.451598 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.451751 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.452130 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.452307 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.452457 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.452614 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.452767 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.452922 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.453076 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.453232 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.453379 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.453526 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.453685 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.453842 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.453996 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.454167 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.454321 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.454477 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.454625 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.454625 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.455025 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.455180 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.455335 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.455489 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.455656 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.456230 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.456586 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.456779 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.457143 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.457301 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.457449 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.457594 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.457756 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.457904 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.458049 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.458201 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.458354 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.458500 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.458659 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.458826 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.458984 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.458984 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.459270 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.459430 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.459586 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.459733 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.459879 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.460056 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.460215 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.460450 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.460601 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.460748 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.460901 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.461093 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.461346 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.461528 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.461679 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.461833 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.461981 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.462134 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.462287 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.462447 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.462603 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.462750 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.462895 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.463057 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.463223 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.463371 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.463525 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.463677 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.463831 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.464006 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.464172 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.464320 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.464474 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.464628 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.464776 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.465036 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.465222 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.465378 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.465526 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.465680 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.465827 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.466736 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.466909 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.467314 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.467548 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.467722 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.467880 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.468061 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.468225 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.468387 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.468540 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.468708 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.468856 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.469015 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.469164 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.469312 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.469466 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.469613 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.469766 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.469926 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.470080 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.470228 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.470393 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.470548 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.470695 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.470860 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.471016 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.471016 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.471303 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.471450 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.471607 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.471763 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.471921 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.472094 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.472264 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.472413 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.472573 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.472720 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.472866 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.473012 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.473164 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.473311 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.473472 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.473628 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.473776 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.473921 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.474067 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.474223 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.474378 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.474533 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.474688 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.474842 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.475007 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.475007 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.475402 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.475557 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.475712 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.475861 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.476027 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.476393 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.476949 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.477111 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.477499 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.477663 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.477819 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.477976 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.478133 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.478288 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.478455 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.478455 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.478748 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.478908 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.479056 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.479214 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.479377 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.480074 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.480509 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.480664 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.480821 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.480975 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.481122 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.481276 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.481437 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.481598 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.481752 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.481899 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.482113 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.482270 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.482270 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.482559 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.482713 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.482867 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.483014 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.483168 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.483326 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.483473 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.483625 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.483625 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.483913 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.484099 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.484249 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.484403 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.484550 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.484696 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.484851 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.485012 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.485159 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.485159 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.485550 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.485550 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.485843 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.485843 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.486142 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.486315 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.486670 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.487178 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.487178 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.487713 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.488078 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.488244 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.488410 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.488410 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.488703 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.488865 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.489028 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.489182 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.489182 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.489459 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.489616 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.489764 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.489917 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.490070 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.490217 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.490371 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.490533 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.490680 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.490832 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.490989 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.491136 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.491292 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.491447 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.491601 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.491749 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.491901 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.492126 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.492280 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.492445 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.492595 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.492748 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.492895 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.493052 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.493282 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.493433 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.493586 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.493748 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.493896 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.494048 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.494209 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.494363 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.494510 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.494656 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.494801 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.494958 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.495114 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.495812 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.496098 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.496252 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.496842 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.497396 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.497561 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.497968 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.498165 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.498324 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.498478 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.498645 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.498811 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.498959 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.499104 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.499250 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.499396 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.499549 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.499698 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.499851 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.500025 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.500179 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.500327 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.500484 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.500641 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.500805 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.500960 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.501193 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.501342 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.501502 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.501656 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.501811 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.501958 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.502179 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.502334 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.502489 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.502644 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.502792 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.502951 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.503106 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.503261 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.503408 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.503553 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.503699 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.503853 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.504020 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.504189 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.504337 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.504491 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.504638 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.504791 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.504949 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.505104 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.505251 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.505415 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.505564 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.505717 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.505897 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.506264 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.506420 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.506566 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.506712 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.507064 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.507638 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.507797 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.507972 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.508387 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.508553 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.508710 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.508870 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.509018 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.509173 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.509328 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.509480 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.509634 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.509790 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.509955 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.510103 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.510257 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.510412 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.510559 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.510741 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.510896 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.511049 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.511197 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.511342 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.511503 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.511650 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.511805 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.511969 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.512154 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.512311 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.512471 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.512471 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.512758 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.512911 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.512911 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.513203 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.513359 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.513506 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.513651 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.513651 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.513958 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.514113 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.514269 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.514424 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.514424 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.514708 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.515348 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.515348 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.515673 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.515829 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.515977 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.516161 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.516447 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.516615 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.516615 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.516896 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.518341 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.518755 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.518913 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.519062 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.519217 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.519373 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.519529 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.519695 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.519849 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.520029 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.520216 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.520387 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.520549 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.520711 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.520867 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.521020 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.521188 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.521353 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.521515 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.521677 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.521843 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.521997 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.522164 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.522318 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.522478 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.522640 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.522803 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.522957 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.523116 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.523270 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.523449 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.523776 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.523957 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.524153 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.524309 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.524472 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.524712 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.524879 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.525034 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.525187 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.525339 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.525500 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.525654 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.525806 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.525960 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.525960 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.526270 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.526733 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.526903 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.527061 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.527387 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.527548 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.528216 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.528392 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.528574 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.528997 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.529162 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.529325 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.529658 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.529834 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.529990 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.530144 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.530297 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.530449 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.530851 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.531018 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.531173 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.531325 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.531478 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.531631 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.531801 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.532153 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.532322 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.532477 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.532631 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.532789 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.532914 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.533005 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.533101 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.533196 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.533285 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.533381 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.533477 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.533566 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.533659 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.533764 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.533855 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.533955 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.534045 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.534132 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.534226 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.534321 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.534408 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.534508 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.534604 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.534692 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.534779 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.534865 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.534959 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.535056 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.535152 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.535241 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.535334 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.535430 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.535526 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.535615 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.535702 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.535789 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.535876 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.535969 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.535969 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.535969 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.535969 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.535969 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.535969 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.536598 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.536716 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.536716 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.536716 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.536716 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.536716 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.536716 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.536716 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.536716 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.537534 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.537534 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.537534 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.537821 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.537985 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.538254 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.538347 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.538347 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.538513 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.538615 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.538711 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.538799 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.538909 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.539244 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.539349 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.539448 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.539537 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.539632 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.539727 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.539822 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.539918 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.540032 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.540122 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.540212 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.540299 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.540385 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.540491 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.540582 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.540678 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.540774 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.540872 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.540961 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.541055 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.541144 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.541237 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.541332 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.541426 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.541520 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.541618 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.541707 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.541800 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.541895 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.542521 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.542620 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.542718 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.542807 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.542894 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.542981 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.543062 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.543150 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.543224 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.543302 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.543376 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.543454 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.543528 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.543611 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.543691 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.543764 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.543842 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.543920 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.544084 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.544179 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.544262 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.544336 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.544414 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.544492 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.544565 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.544648 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.544722 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.544799 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.544879 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.544958 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.545043 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.545122 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.545201 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.545274 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.545351 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.545351 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.545504 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.545577 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.545660 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.545738 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.545818 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.545897 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.545980 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.546059 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.546132 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.546202 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.546279 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.546357 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.546448 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.546528 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.546608 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.546681 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.546759 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.546833 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.546988 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.547070 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.547219 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.547347 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.547505 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.547747 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.547847 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.547947 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.548095 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.548215 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.548302 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.548526 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.548621 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.548758 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.548857 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.548953 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.549041 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.549157 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.549302 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.549401 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.549490 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.549585 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.549679 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.549780 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.549870 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.549957 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.550052 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.550140 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.550240 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.550336 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.550425 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.550518 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.550613 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.550701 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.550981 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.551085 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.551175 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.551270 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.551366 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.551454 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.551454 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.551624 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.551711 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.551805 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.551901 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.552114 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.552223 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.552314 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.552401 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.552488 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.552574 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.552668 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.552758 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.552851 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.552947 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.553042 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.553182 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.553287 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.553376 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.553481 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.553581 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.553669 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.553763 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.553865 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.554002 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.554101 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.554101 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.554321 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.554420 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.554577 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.554678 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.554767 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.554854 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.554947 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.554947 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.555166 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.555324 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.555481 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.555629 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.555776 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.555930 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.556116 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.556276 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.556432 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.556580 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.556726 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.556884 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.557031 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.557178 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.557332 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.557480 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.558683 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.558856 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.559006 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.559176 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.559332 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.559489 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.559602 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.559694 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.559788 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.559875 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.559963 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.560172 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.560302 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.560406 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.560497 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.560571 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.560643 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.560714 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.560714 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.560714 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.560714 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.560714 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.560714 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.561132 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.561215 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.561289 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.561639 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.561745 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.561835 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.561835 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.562026 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.562115 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.562209 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.562338 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.562432 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.562530 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.562619 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.562714 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.562808 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.562904 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.563001 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.563099 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.563187 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.563187 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.563187 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.563187 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.563589 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.563685 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.563685 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.563852 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.563947 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.564071 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.564162 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.564162 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.564319 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.564319 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.564486 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.564583 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.564673 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.564760 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.564854 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.564942 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.565037 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.565133 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.565228 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.565317 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.565411 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.565506 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.565603 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.565691 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.565786 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.565875 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.565968 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.566064 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.566161 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.566256 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.566345 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.566440 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.566528 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.566615 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.566710 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.566799 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.566885 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.566885 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.567051 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.567150 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.567240 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.567328 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.567414 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.567499 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.567711 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.567869 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.568159 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.568341 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.568478 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.568828 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.568944 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.569161 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.569486 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.569797 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.569915 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.570231 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.570380 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.570473 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.570640 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.570737 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.570988 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.571096 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.571343 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.571551 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.571662 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.571954 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.572068 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.572301 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.572418 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.572612 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.572776 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.572924 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.573068 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.573741 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.574079 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.574186 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.574378 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.574475 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.574704 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.574815 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.575021 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.575118 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.575334 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.575437 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.575646 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.575756 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.575955 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.576114 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.576328 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.576436 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.576641 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.576750 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.576982 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.577086 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.577301 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.577396 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.577624 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.577733 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.577942 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.578039 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.578259 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.578354 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.578572 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.578676 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.578908 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.579017 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.579226 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.579356 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.579545 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.579706 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.580205 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.580534 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.580861 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.581392 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.581514 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.581809 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.582134 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.582458 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.583048 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.583385 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.583704 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.584101 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.584426 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.584747 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.585068 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.585385 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.585703 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.586021 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.586184 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.586334 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.586567 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.586674 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.586918 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.587011 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.587260 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.587354 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.587633 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.587741 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.587957 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.588127 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.588310 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.588405 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.588633 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.588736 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.589031 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.589140 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.589383 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.589508 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.589707 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.589837 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.590111 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.590299 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.590403 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.590491 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.590716 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.590818 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.591045 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.591188 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.591361 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.591680 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.591783 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.592097 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.592343 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.592451 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.592662 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.592979 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.593080 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.593300 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.593581 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.593675 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.593939 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.594128 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.594314 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.594643 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.594738 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.594962 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.595110 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.595281 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.595406 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.595603 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.596679 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.596921 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.597107 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.597329 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.597556 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.597649 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.597980 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.598150 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.598304 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.598631 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.598732 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.599082 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.599221 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.599465 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.599605 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.599898 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.600300 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.600493 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.600633 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.600832 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.600955 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.601169 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.601269 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.601496 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.601594 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.601811 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.601910 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.602142 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.602241 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.602463 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.602563 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.602827 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.603030 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.603195 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.603388 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.603553 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.603720 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.603835 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.604162 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.604262 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.604529 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.604639 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.604858 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.604953 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.605173 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.605277 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.605505 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.605614 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.605820 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.605914 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.606134 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.606228 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.606458 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.606567 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.606775 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.606868 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.607088 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.607181 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.607400 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.607502 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.607716 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.607824 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.608053 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.608151 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.608367 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.608474 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.608684 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.608786 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.608999 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.609101 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.609333 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.609468 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.609646 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.609743 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.609956 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.610051 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.610266 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.610398 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.610584 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.610679 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.610921 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.611490 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.611731 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.611830 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.612087 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.612187 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.612420 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.612532 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.612746 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.612862 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.613073 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.613167 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.613390 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.613502 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.613711 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.613804 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.614030 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.614131 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.614353 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.614460 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.614668 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.614769 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.614987 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.615096 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.615296 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.615398 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.615626 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.615718 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.615939 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.616046 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.616679 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.616800 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.616931 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.617032 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.617127 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.617214 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.617308 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.617445 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.617540 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.617806 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.617899 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.618135 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.618239 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.618471 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.618572 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.618807 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.619044 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.619175 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.619388 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.619516 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.619735 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.619861 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.620138 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.620241 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.620469 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.620553 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.620795 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.620888 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.621110 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.621212 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.621678 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.621773 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.621991 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.622077 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.622311 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.622571 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.622669 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.622861 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.622944 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.623187 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.623420 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.623510 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.623583 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.623812 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.623902 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.624172 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.624431 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.624547 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.624723 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.624836 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.625041 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.625125 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.625360 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.625679 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.626095 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.626286 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.626378 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.626619 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.626714 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.627026 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.627120 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.627270 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.627361 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.627593 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.627687 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.627911 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.628042 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.628261 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.628354 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.628579 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.628667 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.628904 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.628998 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.629226 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.629325 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.629566 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.629717 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.629886 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.630019 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.630199 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.630299 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.630533 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.630660 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.630850 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.630978 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.631184 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.631286 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.631506 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.631599 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.631840 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.631942 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.632197 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.632412 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.632527 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.632618 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.632862 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.632972 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.633192 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.633297 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.633512 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.633782 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.633878 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.634129 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.634230 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.634478 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.634574 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.634823 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.634924 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.635138 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.635244 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.635452 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.635554 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.636488 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.636676 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.636776 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.637005 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.637969 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.638072 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.638148 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.638233 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.638317 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.638400 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.638480 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.638553 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.638713 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.638804 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.638967 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.639074 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.639171 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.639259 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.639259 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.639410 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.639510 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.639605 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.639800 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.639893 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.640141 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.640228 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.640524 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.640676 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.640799 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.640892 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.641088 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.641189 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.641408 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.641510 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.641725 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.641827 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.642042 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.642145 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.642370 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.642462 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.642691 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.642820 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.643002 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.643106 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.643319 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.643473 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.643643 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.643736 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.643969 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.644123 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.644313 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.644407 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.644631 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.644725 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.644967 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.645095 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.645284 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.645419 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.645604 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.645748 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.645922 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.646081 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.646240 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.646407 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.646563 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.646740 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.646885 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.647073 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.647217 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.647396 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.647548 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.647727 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.647880 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.648140 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.648251 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.648484 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.648587 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.648835 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.648936 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.649174 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.649275 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.649509 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.649611 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.649780 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 04:30:16.649874 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.650126 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.650443 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.650763 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.651108 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.652153 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.652491 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.652814 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.653149 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.653470 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.653805 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.654138 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.654468 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.654789 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.655131 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.655451 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.655775 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.656117 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.657781 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.657781 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.657781 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.657781 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.657781 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.658490 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.658490 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.658750 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.658967 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.659293 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.659614 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.659951 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.660295 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.660622 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.660950 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.661269 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.661592 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.661920 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.662258 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.662592 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.662926 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.663261 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.663620 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.663941 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.664345 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.664684 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:30:16.664935 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 04:30:16.764793 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_db.sqlalchemy.engines [None req-6fc917c8-26cc-4a32-90b2-40cf2ed58fae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108970) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 04:30:16.779229 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_db.sqlalchemy.engines [None req-04a40c0d-e840-4e05-871f-781e3eae51f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108971) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 04:30:16.844548 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.context [None req-6fc917c8-26cc-4a32-90b2-40cf2ed58fae None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3f04f680-d87c-48d8-b9f0-21b73fb7deea(cell1) {{(pid=108970) load_cells /opt/stack/nova/nova/context.py:464}} Aug 27 04:30:16.848984 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6fc917c8-26cc-4a32-90b2-40cf2ed58fae None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:30:16.850756 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6fc917c8-26cc-4a32-90b2-40cf2ed58fae None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:30:16.851547 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6fc917c8-26cc-4a32-90b2-40cf2ed58fae None None] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:30:16.855487 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6fc917c8-26cc-4a32-90b2-40cf2ed58fae None None] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:30:16.860678 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.context [None req-04a40c0d-e840-4e05-871f-781e3eae51f0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3f04f680-d87c-48d8-b9f0-21b73fb7deea(cell1) {{(pid=108971) load_cells /opt/stack/nova/nova/context.py:464}} Aug 27 04:30:16.866570 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_db.sqlalchemy.engines [None req-6fc917c8-26cc-4a32-90b2-40cf2ed58fae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108970) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 04:30:16.867508 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_db.sqlalchemy.engines [None req-6fc917c8-26cc-4a32-90b2-40cf2ed58fae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108970) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 04:30:16.868521 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-04a40c0d-e840-4e05-871f-781e3eae51f0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:30:16.872573 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-04a40c0d-e840-4e05-871f-781e3eae51f0 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:30:16.873955 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-04a40c0d-e840-4e05-871f-781e3eae51f0 None None] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:30:16.878036 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-04a40c0d-e840-4e05-871f-781e3eae51f0 None None] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:30:16.889174 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_db.sqlalchemy.engines [None req-04a40c0d-e840-4e05-871f-781e3eae51f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108971) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 04:30:16.890457 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_db.sqlalchemy.engines [None req-04a40c0d-e840-4e05-871f-781e3eae51f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108971) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 04:30:17.145101 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_db.sqlalchemy.engines [None req-6fc917c8-26cc-4a32-90b2-40cf2ed58fae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108970) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 04:30:17.169544 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_db.sqlalchemy.engines [None req-04a40c0d-e840-4e05-871f-781e3eae51f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108971) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 04:30:17.478600 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: WARNING keystonemiddleware.auth_token [None req-6fc917c8-26cc-4a32-90b2-40cf2ed58fae None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 04:30:17.486502 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: WARNING keystonemiddleware.auth_token [None req-6fc917c8-26cc-4a32-90b2-40cf2ed58fae None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 04:30:17.514535 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: WARNING keystonemiddleware.auth_token [None req-04a40c0d-e840-4e05-871f-781e3eae51f0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 04:30:17.521398 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: WARNING keystonemiddleware.auth_token [None req-04a40c0d-e840-4e05-871f-781e3eae51f0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 04:30:17.841052 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: WARNING keystonemiddleware.auth_token [None req-6fc917c8-26cc-4a32-90b2-40cf2ed58fae None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 04:30:17.846853 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: WARNING keystonemiddleware.auth_token [None req-6fc917c8-26cc-4a32-90b2-40cf2ed58fae None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 04:30:17.852208 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559b5e6029c0 pid: 108970 (default app) Aug 27 04:30:17.876077 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: WARNING keystonemiddleware.auth_token [None req-04a40c0d-e840-4e05-871f-781e3eae51f0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 04:30:17.881306 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: WARNING keystonemiddleware.auth_token [None req-04a40c0d-e840-4e05-871f-781e3eae51f0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 04:30:17.886766 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559b5e6029c0 pid: 108971 (default app) Aug 27 04:30:52.818077 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-b66afd2f-bc07-455f-a90a-8e9d59fbec16 tempest-VolumesNegativeTest-1844172823 tempest-VolumesNegativeTest-1844172823-project] Action: 'create', calling method: .version_select at 0x7f2079d68ca0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-363756540", "metadata": {"Type": "work"}}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:30:52.819946 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-b66afd2f-bc07-455f-a90a-8e9d59fbec16 tempest-VolumesNegativeTest-1844172823 tempest-VolumesNegativeTest-1844172823-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=108970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:30:52.827822 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-b66afd2f-bc07-455f-a90a-8e9d59fbec16 tempest-VolumesNegativeTest-1844172823 tempest-VolumesNegativeTest-1844172823-project] 10.222.0.53 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 2.040098 Aug 27 04:30:52.828914 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 1/1] 10.222.0.53 () {60 vars in 1156 bytes} [Fri Aug 27 04:30:50 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 2042 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:30:52.843788 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-3ab409a1-d9b0-4fc0-83ba-488891e033fa tempest-VolumesNegativeTest-1844172823 tempest-VolumesNegativeTest-1844172823-project] Action: 'create', calling method: .version_select at 0x7f2079d84820>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-20485049", "metadata": {"Type": "work"}}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:30:52.845373 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-3ab409a1-d9b0-4fc0-83ba-488891e033fa tempest-VolumesNegativeTest-1844172823 tempest-VolumesNegativeTest-1844172823-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=108970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:30:52.846825 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-3ab409a1-d9b0-4fc0-83ba-488891e033fa tempest-VolumesNegativeTest-1844172823 tempest-VolumesNegativeTest-1844172823-project] 10.222.0.53 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012007 Aug 27 04:30:52.852166 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 2/2] 10.222.0.53 () {60 vars in 1156 bytes} [Fri Aug 27 04:30:52 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:30:52.862365 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-b0f60ad1-d5f6-4ae7-a128-87e7c9244546 tempest-VolumesNegativeTest-1844172823 tempest-VolumesNegativeTest-1844172823-project] Action: 'create', calling method: .version_select at 0x7f2079d68d30>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-394553922", "metadata": {"Type": "work"}}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:30:52.868832 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-b0f60ad1-d5f6-4ae7-a128-87e7c9244546 tempest-VolumesNegativeTest-1844172823 tempest-VolumesNegativeTest-1844172823-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=108970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:30:52.870587 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-b0f60ad1-d5f6-4ae7-a128-87e7c9244546 tempest-VolumesNegativeTest-1844172823 tempest-VolumesNegativeTest-1844172823-project] 10.222.0.53 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.017103 Aug 27 04:30:52.874249 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 3/3] 10.222.0.53 () {60 vars in 1156 bytes} [Fri Aug 27 04:30:52 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:30:52.878331 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-0c4fa6d2-f2b0-482b-a4cf-f21db4eddbab tempest-VolumesSnapshotsTestJSON-899220807 tempest-VolumesSnapshotsTestJSON-899220807-project] Action: 'create', calling method: .version_select at 0x7f2079d69ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1367060473"}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:30:52.885812 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-ffd6026d-9050-4a3f-b65c-9d4b8b921ef9 tempest-VolumesNegativeTest-1844172823 tempest-VolumesNegativeTest-1844172823-project] Calling method '.version_select at 0x7f2079d84ca0>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:30:54.909256 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.wsgi [None req-ffd6026d-9050-4a3f-b65c-9d4b8b921ef9 tempest-VolumesNegativeTest-1844172823 tempest-VolumesNegativeTest-1844172823-project] HTTP exception thrown: Volume tempest-invalid-1190922611 could not be found. Aug 27 04:30:54.910214 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-ffd6026d-9050-4a3f-b65c-9d4b8b921ef9 tempest-VolumesNegativeTest-1844172823 tempest-VolumesNegativeTest-1844172823-project] Returning 404 to user: Volume tempest-invalid-1190922611 could not be found. {{(pid=108970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:30:54.911147 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-ffd6026d-9050-4a3f-b65c-9d4b8b921ef9 tempest-VolumesNegativeTest-1844172823 tempest-VolumesNegativeTest-1844172823-project] 10.222.0.53 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1190922611" status: 404 len: 99 microversion: 2.1 time: 2.030057 Aug 27 04:30:54.916877 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 4/4] 10.222.0.53 () {58 vars in 1218 bytes} [Fri Aug 27 04:30:52 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1190922611 => generated 99 bytes in 2036 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:30:54.921816 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-962374b4-a478-42a0-82e3-9f820da18139 tempest-VolumesNegativeTest-1844172823 tempest-VolumesNegativeTest-1844172823-project] 10.222.0.53 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003737 Aug 27 04:30:54.929909 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 5/5] 10.222.0.53 () {58 vars in 1140 bytes} [Fri Aug 27 04:30:54 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 27 04:30:54.943487 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-749c436b-8718-4688-827b-8b8058a5e280 tempest-VolumesNegativeTest-1844172823 tempest-VolumesNegativeTest-1844172823-project] 10.222.0.53 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.012462 Aug 27 04:30:54.952455 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 6/6] 10.222.0.53 () {58 vars in 1137 bytes} [Fri Aug 27 04:30:54 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 22 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 27 04:30:54.962436 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-6d3b39b9-d2bd-43ab-912a-6db326a53721 tempest-VolumesNegativeTest-1844172823 tempest-VolumesNegativeTest-1844172823-project] Calling method '.version_select at 0x7f2079c3ac10>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:30:55.059940 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-0c4fa6d2-f2b0-482b-a4cf-f21db4eddbab tempest-VolumesSnapshotsTestJSON-899220807 tempest-VolumesSnapshotsTestJSON-899220807-project] 10.222.0.53 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.768245 Aug 27 04:30:55.068402 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 1/7] 10.222.0.53 () {60 vars in 1155 bytes} [Fri Aug 27 04:30:51 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 3778 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 27 04:30:55.078854 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-bd2629cd-fbf5-4c95-bdcf-6d70f1272018 tempest-VolumesSnapshotsTestJSON-899220807 tempest-VolumesSnapshotsTestJSON-899220807-project] Calling method '.version_select at 0x7f2079c39700>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:30:55.111809 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.wsgi [None req-6d3b39b9-d2bd-43ab-912a-6db326a53721 tempest-VolumesNegativeTest-1844172823 tempest-VolumesNegativeTest-1844172823-project] HTTP exception thrown: Volume 34c24b46-2b5a-474d-a438-4e8505145cf6 could not be found. Aug 27 04:30:55.112555 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-6d3b39b9-d2bd-43ab-912a-6db326a53721 tempest-VolumesNegativeTest-1844172823 tempest-VolumesNegativeTest-1844172823-project] Returning 404 to user: Volume 34c24b46-2b5a-474d-a438-4e8505145cf6 could not be found. {{(pid=108970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:30:55.113867 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-6d3b39b9-d2bd-43ab-912a-6db326a53721 tempest-VolumesNegativeTest-1844172823 tempest-VolumesNegativeTest-1844172823-project] 10.222.0.53 "DELETE /compute/v2.1/os-volumes/34c24b46-2b5a-474d-a438-4e8505145cf6" status: 404 len: 109 microversion: 2.1 time: 0.160033 Aug 27 04:30:55.114594 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 7/8] 10.222.0.53 () {58 vars in 1248 bytes} [Fri Aug 27 04:30:54 2021] DELETE /compute/v2.1/os-volumes/34c24b46-2b5a-474d-a438-4e8505145cf6 => generated 109 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:30:55.127094 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-58a06547-c86f-4c87-984a-eac1ef22e65b tempest-VolumesNegativeTest-1844172823 tempest-VolumesNegativeTest-1844172823-project] Calling method '.version_select at 0x7f2079c3a790>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:30:55.223795 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-bd2629cd-fbf5-4c95-bdcf-6d70f1272018 tempest-VolumesSnapshotsTestJSON-899220807 tempest-VolumesSnapshotsTestJSON-899220807-project] 10.222.0.53 "GET /compute/v2.1/os-volumes/61cc999b-ebd4-47ef-9f7f-bb0ef837cd1e" status: 200 len: 345 microversion: 2.1 time: 0.153173 Aug 27 04:30:55.226153 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 2/9] 10.222.0.53 () {58 vars in 1245 bytes} [Fri Aug 27 04:30:55 2021] GET /compute/v2.1/os-volumes/61cc999b-ebd4-47ef-9f7f-bb0ef837cd1e => generated 345 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:30:55.261318 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.wsgi [None req-58a06547-c86f-4c87-984a-eac1ef22e65b tempest-VolumesNegativeTest-1844172823 tempest-VolumesNegativeTest-1844172823-project] HTTP exception thrown: Volume 82048671-ed4f-4e97-b8e2-be751cefed60 could not be found. Aug 27 04:30:55.261912 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-58a06547-c86f-4c87-984a-eac1ef22e65b tempest-VolumesNegativeTest-1844172823 tempest-VolumesNegativeTest-1844172823-project] Returning 404 to user: Volume 82048671-ed4f-4e97-b8e2-be751cefed60 could not be found. {{(pid=108970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:30:55.262718 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-58a06547-c86f-4c87-984a-eac1ef22e65b tempest-VolumesNegativeTest-1844172823 tempest-VolumesNegativeTest-1844172823-project] 10.222.0.53 "GET /compute/v2.1/os-volumes/82048671-ed4f-4e97-b8e2-be751cefed60" status: 404 len: 109 microversion: 2.1 time: 0.140004 Aug 27 04:30:55.263259 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 8/10] 10.222.0.53 () {58 vars in 1245 bytes} [Fri Aug 27 04:30:55 2021] GET /compute/v2.1/os-volumes/82048671-ed4f-4e97-b8e2-be751cefed60 => generated 109 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 04:30:56.239238 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-079be471-f67e-41bd-9383-0f5bd2bf0cb7 tempest-VolumesSnapshotsTestJSON-899220807 tempest-VolumesSnapshotsTestJSON-899220807-project] Calling method '.version_select at 0x7f2079c39e50>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:30:56.565553 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-eaeba5db-b671-4db2-8d02-e47444473fcf tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-104751445", "imageRef": "9356e2fa-e55b-41d9-9ca4-53393f2d79fd", "flavorRef": "452", "networks": [{"uuid": "17894bc9-25d9-49d4-92d3-f6025fc86821"}]}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:30:56.581365 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-079be471-f67e-41bd-9383-0f5bd2bf0cb7 tempest-VolumesSnapshotsTestJSON-899220807 tempest-VolumesSnapshotsTestJSON-899220807-project] 10.222.0.53 "GET /compute/v2.1/os-volumes/61cc999b-ebd4-47ef-9f7f-bb0ef837cd1e" status: 200 len: 345 microversion: 2.1 time: 0.346056 Aug 27 04:30:56.582817 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 3/11] 10.222.0.53 () {58 vars in 1245 bytes} [Fri Aug 27 04:30:56 2021] GET /compute/v2.1/os-volumes/61cc999b-ebd4-47ef-9f7f-bb0ef837cd1e => generated 345 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:30:56.859018 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.network.neutron [None req-eaeba5db-b671-4db2-8d02-e47444473fcf tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] validate_networks() for [('17894bc9-25d9-49d4-92d3-f6025fc86821', None, None, None, None, None)] {{(pid=108970) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 04:30:57.602892 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-3b40c4c2-818a-4494-a9a4-9c0287e25457 tempest-VolumesSnapshotsTestJSON-899220807 tempest-VolumesSnapshotsTestJSON-899220807-project] Calling method '.version_select at 0x7f2079c4e0d0>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:30:57.687153 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-3b40c4c2-818a-4494-a9a4-9c0287e25457 tempest-VolumesSnapshotsTestJSON-899220807 tempest-VolumesSnapshotsTestJSON-899220807-project] 10.222.0.53 "GET /compute/v2.1/os-volumes/61cc999b-ebd4-47ef-9f7f-bb0ef837cd1e" status: 200 len: 346 microversion: 2.1 time: 0.095939 Aug 27 04:30:57.688465 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 4/12] 10.222.0.53 () {58 vars in 1245 bytes} [Fri Aug 27 04:30:57 2021] GET /compute/v2.1/os-volumes/61cc999b-ebd4-47ef-9f7f-bb0ef837cd1e => generated 346 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:30:57.708078 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-b1b23b5f-1519-4d05-a38e-0e2018204801 tempest-VolumesSnapshotsTestJSON-899220807 tempest-VolumesSnapshotsTestJSON-899220807-project] Action: 'create', calling method: .version_select at 0x7f2079c4e9d0>, body: {"snapshot": {"volume_id": "61cc999b-ebd4-47ef-9f7f-bb0ef837cd1e", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-831821479"}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:30:58.198516 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-b1b23b5f-1519-4d05-a38e-0e2018204801 tempest-VolumesSnapshotsTestJSON-899220807 tempest-VolumesSnapshotsTestJSON-899220807-project] 10.222.0.53 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.495268 Aug 27 04:30:58.208111 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 5/13] 10.222.0.53 () {60 vars in 1162 bytes} [Fri Aug 27 04:30:57 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:30:58.216303 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-7e4f71ce-a048-4b24-ac28-3ad7d2133692 tempest-VolumesSnapshotsTestJSON-899220807 tempest-VolumesSnapshotsTestJSON-899220807-project] Calling method '.version_select at 0x7f2079c4ea60>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:30:58.267248 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-7e4f71ce-a048-4b24-ac28-3ad7d2133692 tempest-VolumesSnapshotsTestJSON-899220807 tempest-VolumesSnapshotsTestJSON-899220807-project] 10.222.0.53 "GET /compute/v2.1/os-snapshots/65dd7e95-da98-490a-b88e-b0ec13315849" status: 200 len: 286 microversion: 2.1 time: 0.057379 Aug 27 04:30:58.269863 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 6/14] 10.222.0.53 () {58 vars in 1251 bytes} [Fri Aug 27 04:30:58 2021] GET /compute/v2.1/os-snapshots/65dd7e95-da98-490a-b88e-b0ec13315849 => generated 286 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:30:58.280408 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-34864181-ca4f-4dab-9102-885e0f183785 tempest-VolumesSnapshotsTestJSON-899220807 tempest-VolumesSnapshotsTestJSON-899220807-project] Calling method '.version_select at 0x7f2079c4e550>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:30:58.339813 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-34864181-ca4f-4dab-9102-885e0f183785 tempest-VolumesSnapshotsTestJSON-899220807 tempest-VolumesSnapshotsTestJSON-899220807-project] 10.222.0.53 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.063390 Aug 27 04:30:58.340715 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 7/15] 10.222.0.53 () {58 vars in 1140 bytes} [Fri Aug 27 04:30:58 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:30:58.352715 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-4b084f3b-a055-4d64-a3fe-d3e1c403c635 tempest-VolumesSnapshotsTestJSON-899220807 tempest-VolumesSnapshotsTestJSON-899220807-project] Calling method '.version_select at 0x7f2079bd80d0>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:30:58.410145 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-4b084f3b-a055-4d64-a3fe-d3e1c403c635 tempest-VolumesSnapshotsTestJSON-899220807 tempest-VolumesSnapshotsTestJSON-899220807-project] 10.222.0.53 "GET /compute/v2.1/os-snapshots/65dd7e95-da98-490a-b88e-b0ec13315849" status: 200 len: 286 microversion: 2.1 time: 0.061654 Aug 27 04:30:58.410989 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 8/16] 10.222.0.53 () {58 vars in 1251 bytes} [Fri Aug 27 04:30:58 2021] GET /compute/v2.1/os-snapshots/65dd7e95-da98-490a-b88e-b0ec13315849 => generated 286 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:30:58.997805 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.virt.hardware [None req-eaeba5db-b671-4db2-8d02-e47444473fcf tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Flavor limits 0:0:0 {{(pid=108970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:30:59.003824 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.virt.hardware [None req-eaeba5db-b671-4db2-8d02-e47444473fcf tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Image limits 0:0:0 {{(pid=108970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:30:59.004737 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.virt.hardware [None req-eaeba5db-b671-4db2-8d02-e47444473fcf tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Flavor pref 0:0:0 {{(pid=108970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:30:59.012379 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.virt.hardware [None req-eaeba5db-b671-4db2-8d02-e47444473fcf tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Image pref 0:0:0 {{(pid=108970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:30:59.014195 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.virt.hardware [None req-eaeba5db-b671-4db2-8d02-e47444473fcf tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:30:59.058179 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-eaeba5db-b671-4db2-8d02-e47444473fcf tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:30:59.059414 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-eaeba5db-b671-4db2-8d02-e47444473fcf tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:30:59.060683 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-eaeba5db-b671-4db2-8d02-e47444473fcf tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:30:59.061496 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-eaeba5db-b671-4db2-8d02-e47444473fcf tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:30:59.135936 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.quota [None req-eaeba5db-b671-4db2-8d02-e47444473fcf tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Getting quotas for project f90959ac150c48beb4feacbabf64500f. Resources: {'ram', 'cores', 'instances'} {{(pid=108970) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:30:59.153958 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.quota [None req-eaeba5db-b671-4db2-8d02-e47444473fcf tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Getting quotas for user e934818a1e974ea1986b07a7d3e78cb6 and project f90959ac150c48beb4feacbabf64500f. Resources: {'ram', 'cores', 'instances'} {{(pid=108970) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:30:59.179734 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-eaeba5db-b671-4db2-8d02-e47444473fcf tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Going to run 1 instances... {{(pid=108970) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 04:30:59.183208 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-eaeba5db-b671-4db2-8d02-e47444473fcf tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] [instance: a71f46a9-4083-4f82-99fe-e020c5d173c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9356e2fa-e55b-41d9-9ca4-53393f2d79fd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 04:30:59.379387 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-eaeba5db-b671-4db2-8d02-e47444473fcf tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] 10.222.0.53 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.101196 Aug 27 04:30:59.385901 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 9/17] 10.222.0.53 () {60 vars in 1147 bytes} [Fri Aug 27 04:30:56 2021] POST /compute/v2.1/servers => generated 380 bytes in 3103 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:30:59.393691 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-6e63b75c-2ef1-46d6-b9b6-699d66f5b352 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:30:59.394495 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-6e63b75c-2ef1-46d6-b9b6-699d66f5b352 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] [instance: a71f46a9-4083-4f82-99fe-e020c5d173c2] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:30:59.422990 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-fa8c06f3-2a8f-454d-99ed-79cb869ced3f tempest-VolumesSnapshotsTestJSON-899220807 tempest-VolumesSnapshotsTestJSON-899220807-project] Calling method '.version_select at 0x7f2079b52160>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:30:59.577084 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-fa8c06f3-2a8f-454d-99ed-79cb869ced3f tempest-VolumesSnapshotsTestJSON-899220807 tempest-VolumesSnapshotsTestJSON-899220807-project] 10.222.0.53 "GET /compute/v2.1/os-snapshots/65dd7e95-da98-490a-b88e-b0ec13315849" status: 200 len: 286 microversion: 2.1 time: 0.158835 Aug 27 04:30:59.581080 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 10/18] 10.222.0.53 () {58 vars in 1251 bytes} [Fri Aug 27 04:30:59 2021] GET /compute/v2.1/os-snapshots/65dd7e95-da98-490a-b88e-b0ec13315849 => generated 286 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:30:59.695498 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-6e63b75c-2ef1-46d6-b9b6-699d66f5b352 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e934818a1e974ea1986b07a7d3e78cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90959ac150c48beb4feacbabf64500f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:30:59.760220 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-6e63b75c-2ef1-46d6-b9b6-699d66f5b352 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] 10.222.0.53 "GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2" status: 200 len: 1214 microversion: 2.1 time: 0.368974 Aug 27 04:30:59.771720 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 9/19] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:30:59 2021] GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2 => generated 1214 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:00.589402 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-780448b6-6fb9-40a1-92c2-cc31b883b56e tempest-VolumesSnapshotsTestJSON-899220807 tempest-VolumesSnapshotsTestJSON-899220807-project] Calling method '.version_select at 0x7f2079c39790>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:00.660957 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-780448b6-6fb9-40a1-92c2-cc31b883b56e tempest-VolumesSnapshotsTestJSON-899220807 tempest-VolumesSnapshotsTestJSON-899220807-project] 10.222.0.53 "GET /compute/v2.1/os-snapshots/65dd7e95-da98-490a-b88e-b0ec13315849" status: 200 len: 286 microversion: 2.1 time: 0.076290 Aug 27 04:31:00.661878 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 10/20] 10.222.0.53 () {58 vars in 1251 bytes} [Fri Aug 27 04:31:00 2021] GET /compute/v2.1/os-snapshots/65dd7e95-da98-490a-b88e-b0ec13315849 => generated 286 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:31:00.700336 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-19f7c134-6249-427f-b058-87084567fd52 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'create', calling method: .version_select at 0x7f20792d6b80>, body: {"keypair": {"name": "tempest-keypair-1446029779"}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:00.767726 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.quota [None req-19f7c134-6249-427f-b058-87084567fd52 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Getting quotas for project 73010213c0b945979b5a337586b82752. Resources: {'key_pairs'} {{(pid=108970) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:31:00.773223 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-2e71a550-8fab-46f7-817b-1f9f28562cac tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:00.774170 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-2e71a550-8fab-46f7-817b-1f9f28562cac tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] [instance: a71f46a9-4083-4f82-99fe-e020c5d173c2] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:00.800811 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.quota [None req-19f7c134-6249-427f-b058-87084567fd52 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Getting quotas for user 54782c38800c424ca31457987a9d771b and project 73010213c0b945979b5a337586b82752. Resources: {'key_pairs'} {{(pid=108970) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:31:01.016496 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-2e71a550-8fab-46f7-817b-1f9f28562cac tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e934818a1e974ea1986b07a7d3e78cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90959ac150c48beb4feacbabf64500f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:01.027925 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-2e71a550-8fab-46f7-817b-1f9f28562cac tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] 10.222.0.53 "GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2" status: 200 len: 1214 microversion: 2.1 time: 0.258216 Aug 27 04:31:01.035771 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 11/21] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:31:00 2021] GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2 => generated 1214 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:31:01.055440 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.quota [None req-19f7c134-6249-427f-b058-87084567fd52 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Getting quotas for project 73010213c0b945979b5a337586b82752. Resources: {'key_pairs'} {{(pid=108970) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:31:01.060978 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.quota [None req-19f7c134-6249-427f-b058-87084567fd52 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Getting quotas for user 54782c38800c424ca31457987a9d771b and project 73010213c0b945979b5a337586b82752. Resources: {'key_pairs'} {{(pid=108970) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:31:01.107336 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-19f7c134-6249-427f-b058-87084567fd52 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.810102 Aug 27 04:31:01.113470 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 11/22] 10.222.0.53 () {60 vars in 1158 bytes} [Fri Aug 27 04:31:00 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:01.673339 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-e9359541-c268-4867-ac0c-8369dc40b414 tempest-VolumesSnapshotsTestJSON-899220807 tempest-VolumesSnapshotsTestJSON-899220807-project] Calling method '.version_select at 0x7f2079b98ee0>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:01.723980 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-e9359541-c268-4867-ac0c-8369dc40b414 tempest-VolumesSnapshotsTestJSON-899220807 tempest-VolumesSnapshotsTestJSON-899220807-project] 10.222.0.53 "GET /compute/v2.1/os-snapshots/65dd7e95-da98-490a-b88e-b0ec13315849" status: 200 len: 286 microversion: 2.1 time: 0.054471 Aug 27 04:31:01.725088 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 12/23] 10.222.0.53 () {58 vars in 1251 bytes} [Fri Aug 27 04:31:01 2021] GET /compute/v2.1/os-snapshots/65dd7e95-da98-490a-b88e-b0ec13315849 => generated 286 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:31:02.052031 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-e280e508-f66a-401d-b793-70ac4661e214 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:02.052662 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-e280e508-f66a-401d-b793-70ac4661e214 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] [instance: a71f46a9-4083-4f82-99fe-e020c5d173c2] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:02.075706 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e280e508-f66a-401d-b793-70ac4661e214 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:02.076201 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e280e508-f66a-401d-b793-70ac4661e214 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:02.077002 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e280e508-f66a-401d-b793-70ac4661e214 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:02.084078 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e280e508-f66a-401d-b793-70ac4661e214 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:02.467803 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-e280e508-f66a-401d-b793-70ac4661e214 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e934818a1e974ea1986b07a7d3e78cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90959ac150c48beb4feacbabf64500f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:02.503826 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-e280e508-f66a-401d-b793-70ac4661e214 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] 10.222.0.53 "GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2" status: 200 len: 1218 microversion: 2.1 time: 0.454351 Aug 27 04:31:02.520390 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 12/24] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:31:02 2021] GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2 => generated 1218 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:02.735658 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-e995d9a5-258a-4f51-9572-b5dde5bb00a7 tempest-VolumesSnapshotsTestJSON-899220807 tempest-VolumesSnapshotsTestJSON-899220807-project] Calling method '.version_select at 0x7f2079c4e820>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:02.785837 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-e995d9a5-258a-4f51-9572-b5dde5bb00a7 tempest-VolumesSnapshotsTestJSON-899220807 tempest-VolumesSnapshotsTestJSON-899220807-project] 10.222.0.53 "GET /compute/v2.1/os-snapshots/65dd7e95-da98-490a-b88e-b0ec13315849" status: 200 len: 286 microversion: 2.1 time: 0.053595 Aug 27 04:31:02.786942 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 13/25] 10.222.0.53 () {58 vars in 1251 bytes} [Fri Aug 27 04:31:02 2021] GET /compute/v2.1/os-snapshots/65dd7e95-da98-490a-b88e-b0ec13315849 => generated 286 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:31:03.528236 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-88e79751-306a-4cfc-a384-51d3cc0e5546 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:03.530067 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-88e79751-306a-4cfc-a384-51d3cc0e5546 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] [instance: a71f46a9-4083-4f82-99fe-e020c5d173c2] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:03.541828 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-88e79751-306a-4cfc-a384-51d3cc0e5546 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:03.543453 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-88e79751-306a-4cfc-a384-51d3cc0e5546 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:03.545802 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-88e79751-306a-4cfc-a384-51d3cc0e5546 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:03.546399 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-88e79751-306a-4cfc-a384-51d3cc0e5546 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:03.717265 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-88e79751-306a-4cfc-a384-51d3cc0e5546 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e934818a1e974ea1986b07a7d3e78cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90959ac150c48beb4feacbabf64500f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:03.731097 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-88e79751-306a-4cfc-a384-51d3cc0e5546 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] 10.222.0.53 "GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2" status: 200 len: 1218 microversion: 2.1 time: 0.208027 Aug 27 04:31:03.731942 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 13/26] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:31:03 2021] GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2 => generated 1218 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:03.799331 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-2537bdf3-5d0b-4374-ae41-39416083f566 tempest-VolumesSnapshotsTestJSON-899220807 tempest-VolumesSnapshotsTestJSON-899220807-project] Calling method '.version_select at 0x7f2079ba7550>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:03.881037 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-2537bdf3-5d0b-4374-ae41-39416083f566 tempest-VolumesSnapshotsTestJSON-899220807 tempest-VolumesSnapshotsTestJSON-899220807-project] 10.222.0.53 "GET /compute/v2.1/os-snapshots/65dd7e95-da98-490a-b88e-b0ec13315849" status: 200 len: 286 microversion: 2.1 time: 0.086779 Aug 27 04:31:03.887666 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 14/27] 10.222.0.53 () {58 vars in 1251 bytes} [Fri Aug 27 04:31:03 2021] GET /compute/v2.1/os-snapshots/65dd7e95-da98-490a-b88e-b0ec13315849 => generated 286 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:31:04.751938 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-ee3f818c-ec14-4e75-871d-3f1e08618a78 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:04.752645 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-ee3f818c-ec14-4e75-871d-3f1e08618a78 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] [instance: a71f46a9-4083-4f82-99fe-e020c5d173c2] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:04.764112 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ee3f818c-ec14-4e75-871d-3f1e08618a78 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:04.768306 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ee3f818c-ec14-4e75-871d-3f1e08618a78 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:04.769445 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ee3f818c-ec14-4e75-871d-3f1e08618a78 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:04.770089 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ee3f818c-ec14-4e75-871d-3f1e08618a78 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:04.898245 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-971efce8-7c46-4bfd-91ce-a942cdc3a022 tempest-VolumesSnapshotsTestJSON-899220807 tempest-VolumesSnapshotsTestJSON-899220807-project] Calling method '.version_select at 0x7f2079b98550>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:04.951937 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-971efce8-7c46-4bfd-91ce-a942cdc3a022 tempest-VolumesSnapshotsTestJSON-899220807 tempest-VolumesSnapshotsTestJSON-899220807-project] 10.222.0.53 "GET /compute/v2.1/os-snapshots/65dd7e95-da98-490a-b88e-b0ec13315849" status: 200 len: 287 microversion: 2.1 time: 0.057791 Aug 27 04:31:04.958048 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 15/28] 10.222.0.53 () {58 vars in 1251 bytes} [Fri Aug 27 04:31:04 2021] GET /compute/v2.1/os-snapshots/65dd7e95-da98-490a-b88e-b0ec13315849 => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:31:05.001278 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-0fe5cf5b-425f-43e3-8319-6e883ac48129 tempest-VolumesSnapshotsTestJSON-899220807 tempest-VolumesSnapshotsTestJSON-899220807-project] Calling method '.version_select at 0x7f2079b98d30>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:05.033870 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-ee3f818c-ec14-4e75-871d-3f1e08618a78 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e934818a1e974ea1986b07a7d3e78cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90959ac150c48beb4feacbabf64500f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:05.068211 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-ee3f818c-ec14-4e75-871d-3f1e08618a78 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] 10.222.0.53 "GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2" status: 200 len: 1266 microversion: 2.1 time: 0.315170 Aug 27 04:31:05.073772 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 14/29] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:31:04 2021] GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2 => generated 1266 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:05.138923 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-0fe5cf5b-425f-43e3-8319-6e883ac48129 tempest-VolumesSnapshotsTestJSON-899220807 tempest-VolumesSnapshotsTestJSON-899220807-project] 10.222.0.53 "DELETE /compute/v2.1/os-snapshots/65dd7e95-da98-490a-b88e-b0ec13315849" status: 202 len: 0 microversion: 2.1 time: 0.148154 Aug 27 04:31:05.141014 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 16/30] 10.222.0.53 () {58 vars in 1254 bytes} [Fri Aug 27 04:31:04 2021] DELETE /compute/v2.1/os-snapshots/65dd7e95-da98-490a-b88e-b0ec13315849 => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:31:05.152114 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-3235cb79-4cac-4b09-9210-07ce21a8b925 tempest-VolumesSnapshotsTestJSON-899220807 tempest-VolumesSnapshotsTestJSON-899220807-project] Calling method '.version_select at 0x7f2079308af0>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:05.206234 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-3235cb79-4cac-4b09-9210-07ce21a8b925 tempest-VolumesSnapshotsTestJSON-899220807 tempest-VolumesSnapshotsTestJSON-899220807-project] 10.222.0.53 "GET /compute/v2.1/os-snapshots/65dd7e95-da98-490a-b88e-b0ec13315849" status: 200 len: 286 microversion: 2.1 time: 0.060011 Aug 27 04:31:05.206450 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 15/31] 10.222.0.53 () {58 vars in 1251 bytes} [Fri Aug 27 04:31:05 2021] GET /compute/v2.1/os-snapshots/65dd7e95-da98-490a-b88e-b0ec13315849 => generated 286 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:31:05.835279 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-80503385-6392-4abd-8cd2-47c47615cd70 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1721692224", "imageRef": "9356e2fa-e55b-41d9-9ca4-53393f2d79fd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a919ac5d-841a-4ae2-b353-26d1ed741c31"}], "security_groups": [{"name": "tempest-securitygroup--321806273"}], "key_name": "tempest-keypair-1446029779", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:06.091803 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-fb427602-afe4-4a4a-a354-3eccee9cf1f1 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:06.092685 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-fb427602-afe4-4a4a-a354-3eccee9cf1f1 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] [instance: a71f46a9-4083-4f82-99fe-e020c5d173c2] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:06.111696 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fb427602-afe4-4a4a-a354-3eccee9cf1f1 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:06.112431 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fb427602-afe4-4a4a-a354-3eccee9cf1f1 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:06.114768 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fb427602-afe4-4a4a-a354-3eccee9cf1f1 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:06.116184 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fb427602-afe4-4a4a-a354-3eccee9cf1f1 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:06.230853 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.network.neutron [None req-80503385-6392-4abd-8cd2-47c47615cd70 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] validate_networks() for [('a919ac5d-841a-4ae2-b353-26d1ed741c31', None, None, None, None, None)] {{(pid=108971) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 04:31:06.252256 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-fb427602-afe4-4a4a-a354-3eccee9cf1f1 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e934818a1e974ea1986b07a7d3e78cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90959ac150c48beb4feacbabf64500f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:06.268271 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-fb427602-afe4-4a4a-a354-3eccee9cf1f1 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] 10.222.0.53 "GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2" status: 200 len: 1266 microversion: 2.1 time: 0.180701 Aug 27 04:31:06.272154 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 16/32] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:31:06 2021] GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:06.295716 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-e8c5789d-2e84-42b1-810d-298a492d9ee6 tempest-VolumesSnapshotsTestJSON-899220807 tempest-VolumesSnapshotsTestJSON-899220807-project] Calling method '.version_select at 0x7f20781d7ee0>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:06.338392 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-e8c5789d-2e84-42b1-810d-298a492d9ee6 tempest-VolumesSnapshotsTestJSON-899220807 tempest-VolumesSnapshotsTestJSON-899220807-project] 10.222.0.53 "GET /compute/v2.1/os-snapshots/65dd7e95-da98-490a-b88e-b0ec13315849" status: 200 len: 286 microversion: 2.1 time: 0.063947 Aug 27 04:31:06.338979 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 17/33] 10.222.0.53 () {58 vars in 1251 bytes} [Fri Aug 27 04:31:06 2021] GET /compute/v2.1/os-snapshots/65dd7e95-da98-490a-b88e-b0ec13315849 => generated 286 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:31:06.969950 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-fd1bcb2e-5cd7-43b4-bdd4-8f3ee4f0af1f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'create', calling method: .version_select at 0x7f2079c4ea60>, body: {"keypair": {"name": "tempest-keypair-839120903"}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:06.989146 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.quota [None req-fd1bcb2e-5cd7-43b4-bdd4-8f3ee4f0af1f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Getting quotas for project a6be58896fed46208a356cedf5a8513e. Resources: {'key_pairs'} {{(pid=108970) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:31:06.997053 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.quota [None req-fd1bcb2e-5cd7-43b4-bdd4-8f3ee4f0af1f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Getting quotas for user ebedf95669444aa29994308a5f59ee2d and project a6be58896fed46208a356cedf5a8513e. Resources: {'key_pairs'} {{(pid=108970) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:31:07.320271 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.quota [None req-fd1bcb2e-5cd7-43b4-bdd4-8f3ee4f0af1f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Getting quotas for project a6be58896fed46208a356cedf5a8513e. Resources: {'key_pairs'} {{(pid=108970) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:31:07.326832 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.quota [None req-fd1bcb2e-5cd7-43b4-bdd4-8f3ee4f0af1f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Getting quotas for user ebedf95669444aa29994308a5f59ee2d and project a6be58896fed46208a356cedf5a8513e. Resources: {'key_pairs'} {{(pid=108970) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:31:07.370064 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-fd1bcb2e-5cd7-43b4-bdd4-8f3ee4f0af1f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.692320 Aug 27 04:31:07.371193 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 18/34] 10.222.0.53 () {62 vars in 1199 bytes} [Fri Aug 27 04:31:06 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 696 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Aug 27 04:31:07.376372 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-004bcbcc-cb38-409b-8d31-2c245e55864e tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:07.389546 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-004bcbcc-cb38-409b-8d31-2c245e55864e tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] [instance: a71f46a9-4083-4f82-99fe-e020c5d173c2] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:07.397146 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.virt.hardware [None req-80503385-6392-4abd-8cd2-47c47615cd70 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Flavor limits 0:0:0 {{(pid=108971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:31:07.397620 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.virt.hardware [None req-80503385-6392-4abd-8cd2-47c47615cd70 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Image limits 0:0:0 {{(pid=108971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:31:07.398040 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.virt.hardware [None req-80503385-6392-4abd-8cd2-47c47615cd70 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Flavor pref 0:0:0 {{(pid=108971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:31:07.398465 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.virt.hardware [None req-80503385-6392-4abd-8cd2-47c47615cd70 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Image pref 0:0:0 {{(pid=108971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:31:07.398857 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.virt.hardware [None req-80503385-6392-4abd-8cd2-47c47615cd70 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:31:07.410912 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-004bcbcc-cb38-409b-8d31-2c245e55864e tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:07.411363 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-004bcbcc-cb38-409b-8d31-2c245e55864e tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:07.412421 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-004bcbcc-cb38-409b-8d31-2c245e55864e tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:07.413041 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-004bcbcc-cb38-409b-8d31-2c245e55864e tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:07.422139 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-80503385-6392-4abd-8cd2-47c47615cd70 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:07.422589 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-80503385-6392-4abd-8cd2-47c47615cd70 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:07.426286 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-80503385-6392-4abd-8cd2-47c47615cd70 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:07.427529 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-80503385-6392-4abd-8cd2-47c47615cd70 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:07.477522 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.quota [None req-80503385-6392-4abd-8cd2-47c47615cd70 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Getting quotas for project 73010213c0b945979b5a337586b82752. Resources: {'ram', 'cores', 'instances'} {{(pid=108971) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:31:07.485741 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.quota [None req-80503385-6392-4abd-8cd2-47c47615cd70 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Getting quotas for user 54782c38800c424ca31457987a9d771b and project 73010213c0b945979b5a337586b82752. Resources: {'ram', 'cores', 'instances'} {{(pid=108971) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:31:07.501575 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-80503385-6392-4abd-8cd2-47c47615cd70 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Going to run 1 instances... {{(pid=108971) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 04:31:07.505543 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-80503385-6392-4abd-8cd2-47c47615cd70 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9356e2fa-e55b-41d9-9ca4-53393f2d79fd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 04:31:07.517267 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-004bcbcc-cb38-409b-8d31-2c245e55864e tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e934818a1e974ea1986b07a7d3e78cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90959ac150c48beb4feacbabf64500f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:07.528607 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-004bcbcc-cb38-409b-8d31-2c245e55864e tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] 10.222.0.53 "GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2" status: 200 len: 1266 microversion: 2.1 time: 0.153724 Aug 27 04:31:07.530987 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 19/35] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:31:07 2021] GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:07.535580 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-5435277e-51c9-424d-b2cb-eaeff6d416b8 tempest-VolumesSnapshotsTestJSON-899220807 tempest-VolumesSnapshotsTestJSON-899220807-project] Calling method '.version_select at 0x7f20781fb550>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:07.619873 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-5435277e-51c9-424d-b2cb-eaeff6d416b8 tempest-VolumesSnapshotsTestJSON-899220807 tempest-VolumesSnapshotsTestJSON-899220807-project] 10.222.0.53 "GET /compute/v2.1/os-snapshots/65dd7e95-da98-490a-b88e-b0ec13315849" status: 200 len: 286 microversion: 2.1 time: 0.087540 Aug 27 04:31:07.625172 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 20/36] 10.222.0.53 () {58 vars in 1251 bytes} [Fri Aug 27 04:31:07 2021] GET /compute/v2.1/os-snapshots/65dd7e95-da98-490a-b88e-b0ec13315849 => generated 286 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:31:07.670357 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-80503385-6392-4abd-8cd2-47c47615cd70 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.846947 Aug 27 04:31:07.671262 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 17/37] 10.222.0.53 () {60 vars in 1147 bytes} [Fri Aug 27 04:31:05 2021] POST /compute/v2.1/servers => generated 401 bytes in 1848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:31:07.684318 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-f9fc29a0-f8a1-40a8-a980-01f3571e10f2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:07.684984 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-f9fc29a0-f8a1-40a8-a980-01f3571e10f2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:07.892648 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-f9fc29a0-f8a1-40a8-a980-01f3571e10f2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:07.910071 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-f9fc29a0-f8a1-40a8-a980-01f3571e10f2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1238 microversion: 2.1 time: 0.232390 Aug 27 04:31:07.919892 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 21/38] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:31:07 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1238 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:08.579420 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-1d2a4438-fd2d-4721-85dd-4113d9f34022 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:08.580240 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-1d2a4438-fd2d-4721-85dd-4113d9f34022 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] [instance: a71f46a9-4083-4f82-99fe-e020c5d173c2] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:08.631375 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-4df3d730-9f10-4331-901b-31b565cd247f tempest-VolumesSnapshotsTestJSON-899220807 tempest-VolumesSnapshotsTestJSON-899220807-project] Calling method '.version_select at 0x7f20781fb5e0>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:08.649637 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1d2a4438-fd2d-4721-85dd-4113d9f34022 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:08.652796 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1d2a4438-fd2d-4721-85dd-4113d9f34022 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:08.655707 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1d2a4438-fd2d-4721-85dd-4113d9f34022 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:08.656244 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1d2a4438-fd2d-4721-85dd-4113d9f34022 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:08.700931 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-4df3d730-9f10-4331-901b-31b565cd247f tempest-VolumesSnapshotsTestJSON-899220807 tempest-VolumesSnapshotsTestJSON-899220807-project] 10.222.0.53 "GET /compute/v2.1/os-snapshots/65dd7e95-da98-490a-b88e-b0ec13315849" status: 200 len: 286 microversion: 2.1 time: 0.073123 Aug 27 04:31:08.703222 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 22/39] 10.222.0.53 () {58 vars in 1251 bytes} [Fri Aug 27 04:31:08 2021] GET /compute/v2.1/os-snapshots/65dd7e95-da98-490a-b88e-b0ec13315849 => generated 286 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:31:08.938129 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-b1dba43e-1b1c-48b8-ba81-1db2c9a7a231 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:08.939158 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-b1dba43e-1b1c-48b8-ba81-1db2c9a7a231 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:09.212933 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-1d2a4438-fd2d-4721-85dd-4113d9f34022 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e934818a1e974ea1986b07a7d3e78cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90959ac150c48beb4feacbabf64500f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:09.231645 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-1d2a4438-fd2d-4721-85dd-4113d9f34022 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] 10.222.0.53 "GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2" status: 200 len: 1284 microversion: 2.1 time: 0.673568 Aug 27 04:31:09.232360 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 18/40] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:31:08 2021] GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2 => generated 1284 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:09.252378 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-b1dba43e-1b1c-48b8-ba81-1db2c9a7a231 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:09.260208 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-b1dba43e-1b1c-48b8-ba81-1db2c9a7a231 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1238 microversion: 2.1 time: 0.328043 Aug 27 04:31:09.260973 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 23/41] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:31:08 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1238 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:31:09.713609 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-6198387b-8312-4d2b-8e36-00f4d0e48102 tempest-VolumesSnapshotsTestJSON-899220807 tempest-VolumesSnapshotsTestJSON-899220807-project] Calling method '.version_select at 0x7f2078a8edc0>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:09.841909 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.wsgi [None req-6198387b-8312-4d2b-8e36-00f4d0e48102 tempest-VolumesSnapshotsTestJSON-899220807 tempest-VolumesSnapshotsTestJSON-899220807-project] HTTP exception thrown: Snapshot 65dd7e95-da98-490a-b88e-b0ec13315849 could not be found. Aug 27 04:31:09.842533 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-6198387b-8312-4d2b-8e36-00f4d0e48102 tempest-VolumesSnapshotsTestJSON-899220807 tempest-VolumesSnapshotsTestJSON-899220807-project] Returning 404 to user: Snapshot 65dd7e95-da98-490a-b88e-b0ec13315849 could not be found. {{(pid=108971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:31:09.843363 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-6198387b-8312-4d2b-8e36-00f4d0e48102 tempest-VolumesSnapshotsTestJSON-899220807 tempest-VolumesSnapshotsTestJSON-899220807-project] 10.222.0.53 "GET /compute/v2.1/os-snapshots/65dd7e95-da98-490a-b88e-b0ec13315849" status: 404 len: 111 microversion: 2.1 time: 0.133882 Aug 27 04:31:09.844278 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 19/42] 10.222.0.53 () {58 vars in 1251 bytes} [Fri Aug 27 04:31:09 2021] GET /compute/v2.1/os-snapshots/65dd7e95-da98-490a-b88e-b0ec13315849 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 04:31:09.853288 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-f2429436-caaf-46ec-bf8a-315c5d718a35 tempest-VolumesSnapshotsTestJSON-899220807 tempest-VolumesSnapshotsTestJSON-899220807-project] Calling method '.version_select at 0x7f20781f45e0>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:10.008396 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-f2429436-caaf-46ec-bf8a-315c5d718a35 tempest-VolumesSnapshotsTestJSON-899220807 tempest-VolumesSnapshotsTestJSON-899220807-project] 10.222.0.53 "DELETE /compute/v2.1/os-volumes/61cc999b-ebd4-47ef-9f7f-bb0ef837cd1e" status: 202 len: 0 microversion: 2.1 time: 0.159190 Aug 27 04:31:10.010279 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 24/43] 10.222.0.53 () {58 vars in 1248 bytes} [Fri Aug 27 04:31:09 2021] DELETE /compute/v2.1/os-volumes/61cc999b-ebd4-47ef-9f7f-bb0ef837cd1e => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:31:10.020018 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-9172a7be-9468-4d45-bc96-4afef7b79dc6 tempest-VolumesSnapshotsTestJSON-899220807 tempest-VolumesSnapshotsTestJSON-899220807-project] Calling method '.version_select at 0x7f207a5bd040>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:10.250672 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-9f3e0434-e881-4d7c-85a0-fe91d4c9fad6 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:10.251588 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-9f3e0434-e881-4d7c-85a0-fe91d4c9fad6 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] [instance: a71f46a9-4083-4f82-99fe-e020c5d173c2] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:10.265632 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-9172a7be-9468-4d45-bc96-4afef7b79dc6 tempest-VolumesSnapshotsTestJSON-899220807 tempest-VolumesSnapshotsTestJSON-899220807-project] 10.222.0.53 "GET /compute/v2.1/os-volumes/61cc999b-ebd4-47ef-9f7f-bb0ef837cd1e" status: 200 len: 345 microversion: 2.1 time: 0.250978 Aug 27 04:31:10.266229 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 20/44] 10.222.0.53 () {58 vars in 1245 bytes} [Fri Aug 27 04:31:10 2021] GET /compute/v2.1/os-volumes/61cc999b-ebd4-47ef-9f7f-bb0ef837cd1e => generated 345 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:31:10.273514 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9f3e0434-e881-4d7c-85a0-fe91d4c9fad6 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:10.274269 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9f3e0434-e881-4d7c-85a0-fe91d4c9fad6 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:10.275275 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9f3e0434-e881-4d7c-85a0-fe91d4c9fad6 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:10.277625 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9f3e0434-e881-4d7c-85a0-fe91d4c9fad6 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:10.280153 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-65e7db72-b54d-4f3b-8679-f6a79477c6cc tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:10.280988 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-65e7db72-b54d-4f3b-8679-f6a79477c6cc tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:10.312588 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-65e7db72-b54d-4f3b-8679-f6a79477c6cc tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:10.314105 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-65e7db72-b54d-4f3b-8679-f6a79477c6cc tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:10.324033 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-65e7db72-b54d-4f3b-8679-f6a79477c6cc tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:10.335502 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-65e7db72-b54d-4f3b-8679-f6a79477c6cc tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:10.588521 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-9f3e0434-e881-4d7c-85a0-fe91d4c9fad6 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e934818a1e974ea1986b07a7d3e78cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90959ac150c48beb4feacbabf64500f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:10.603130 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-9f3e0434-e881-4d7c-85a0-fe91d4c9fad6 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] 10.222.0.53 "GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2" status: 200 len: 1272 microversion: 2.1 time: 0.355797 Aug 27 04:31:10.615278 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 25/45] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:31:10 2021] GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2 => generated 1272 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:10.692462 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-65e7db72-b54d-4f3b-8679-f6a79477c6cc tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:10.711216 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-65e7db72-b54d-4f3b-8679-f6a79477c6cc tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1290 microversion: 2.1 time: 0.436537 Aug 27 04:31:10.714858 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 21/46] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:31:10 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1290 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:11.279109 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-23648dd9-0705-49c6-9cbb-98ed8862dc93 tempest-VolumesSnapshotsTestJSON-899220807 tempest-VolumesSnapshotsTestJSON-899220807-project] Calling method '.version_select at 0x7f20781f41f0>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:11.359887 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.wsgi [None req-23648dd9-0705-49c6-9cbb-98ed8862dc93 tempest-VolumesSnapshotsTestJSON-899220807 tempest-VolumesSnapshotsTestJSON-899220807-project] HTTP exception thrown: Volume 61cc999b-ebd4-47ef-9f7f-bb0ef837cd1e could not be found. Aug 27 04:31:11.360882 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-23648dd9-0705-49c6-9cbb-98ed8862dc93 tempest-VolumesSnapshotsTestJSON-899220807 tempest-VolumesSnapshotsTestJSON-899220807-project] Returning 404 to user: Volume 61cc999b-ebd4-47ef-9f7f-bb0ef837cd1e could not be found. {{(pid=108970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:31:11.370799 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-23648dd9-0705-49c6-9cbb-98ed8862dc93 tempest-VolumesSnapshotsTestJSON-899220807 tempest-VolumesSnapshotsTestJSON-899220807-project] 10.222.0.53 "GET /compute/v2.1/os-volumes/61cc999b-ebd4-47ef-9f7f-bb0ef837cd1e" status: 404 len: 109 microversion: 2.1 time: 0.087384 Aug 27 04:31:11.372130 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 26/47] 10.222.0.53 () {58 vars in 1245 bytes} [Fri Aug 27 04:31:11 2021] GET /compute/v2.1/os-volumes/61cc999b-ebd4-47ef-9f7f-bb0ef837cd1e => generated 109 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:31:11.384390 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-264fc54e-dd08-4eb3-bd58-c0a051c6d5df tempest-VolumesSnapshotsTestJSON-899220807 tempest-VolumesSnapshotsTestJSON-899220807-project] Calling method '.version_select at 0x7f2079b10700>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:11.479005 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.wsgi [None req-264fc54e-dd08-4eb3-bd58-c0a051c6d5df tempest-VolumesSnapshotsTestJSON-899220807 tempest-VolumesSnapshotsTestJSON-899220807-project] HTTP exception thrown: Volume 61cc999b-ebd4-47ef-9f7f-bb0ef837cd1e could not be found. Aug 27 04:31:11.479959 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-264fc54e-dd08-4eb3-bd58-c0a051c6d5df tempest-VolumesSnapshotsTestJSON-899220807 tempest-VolumesSnapshotsTestJSON-899220807-project] Returning 404 to user: Volume 61cc999b-ebd4-47ef-9f7f-bb0ef837cd1e could not be found. {{(pid=108971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:31:11.480982 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-264fc54e-dd08-4eb3-bd58-c0a051c6d5df tempest-VolumesSnapshotsTestJSON-899220807 tempest-VolumesSnapshotsTestJSON-899220807-project] 10.222.0.53 "DELETE /compute/v2.1/os-volumes/61cc999b-ebd4-47ef-9f7f-bb0ef837cd1e" status: 404 len: 109 microversion: 2.1 time: 0.103425 Aug 27 04:31:11.481738 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 22/48] 10.222.0.53 () {58 vars in 1248 bytes} [Fri Aug 27 04:31:11 2021] DELETE /compute/v2.1/os-volumes/61cc999b-ebd4-47ef-9f7f-bb0ef837cd1e => generated 109 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:31:11.491329 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-77f12c3d-6105-4e45-951b-3dcad9aae8da tempest-VolumesSnapshotsTestJSON-899220807 tempest-VolumesSnapshotsTestJSON-899220807-project] Calling method '.version_select at 0x7f20781fb700>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:11.578108 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.wsgi [None req-77f12c3d-6105-4e45-951b-3dcad9aae8da tempest-VolumesSnapshotsTestJSON-899220807 tempest-VolumesSnapshotsTestJSON-899220807-project] HTTP exception thrown: Volume 61cc999b-ebd4-47ef-9f7f-bb0ef837cd1e could not be found. Aug 27 04:31:11.578964 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-77f12c3d-6105-4e45-951b-3dcad9aae8da tempest-VolumesSnapshotsTestJSON-899220807 tempest-VolumesSnapshotsTestJSON-899220807-project] Returning 404 to user: Volume 61cc999b-ebd4-47ef-9f7f-bb0ef837cd1e could not be found. {{(pid=108970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:31:11.580675 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-77f12c3d-6105-4e45-951b-3dcad9aae8da tempest-VolumesSnapshotsTestJSON-899220807 tempest-VolumesSnapshotsTestJSON-899220807-project] 10.222.0.53 "GET /compute/v2.1/os-volumes/61cc999b-ebd4-47ef-9f7f-bb0ef837cd1e" status: 404 len: 109 microversion: 2.1 time: 0.093369 Aug 27 04:31:11.581488 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 27/49] 10.222.0.53 () {58 vars in 1245 bytes} [Fri Aug 27 04:31:11 2021] GET /compute/v2.1/os-volumes/61cc999b-ebd4-47ef-9f7f-bb0ef837cd1e => generated 109 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:31:11.624223 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-be666367-de0d-4871-a70c-f91c77667b93 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:11.625001 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-be666367-de0d-4871-a70c-f91c77667b93 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] [instance: a71f46a9-4083-4f82-99fe-e020c5d173c2] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:11.637710 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-be666367-de0d-4871-a70c-f91c77667b93 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:11.638856 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-be666367-de0d-4871-a70c-f91c77667b93 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:11.641256 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-be666367-de0d-4871-a70c-f91c77667b93 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:11.641960 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-be666367-de0d-4871-a70c-f91c77667b93 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:11.752084 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-6cfd6134-8926-4e0a-b4cc-3c6f579523f7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:11.762440 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-6cfd6134-8926-4e0a-b4cc-3c6f579523f7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:11.791957 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6cfd6134-8926-4e0a-b4cc-3c6f579523f7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:11.795128 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6cfd6134-8926-4e0a-b4cc-3c6f579523f7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:11.797285 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6cfd6134-8926-4e0a-b4cc-3c6f579523f7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:11.802011 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6cfd6134-8926-4e0a-b4cc-3c6f579523f7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:11.999372 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-6cfd6134-8926-4e0a-b4cc-3c6f579523f7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:12.011772 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-6cfd6134-8926-4e0a-b4cc-3c6f579523f7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1296 microversion: 2.1 time: 0.280301 Aug 27 04:31:12.025934 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 28/50] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:31:11 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1296 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:12.454953 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-be666367-de0d-4871-a70c-f91c77667b93 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e934818a1e974ea1986b07a7d3e78cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90959ac150c48beb4feacbabf64500f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:12.465542 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-be666367-de0d-4871-a70c-f91c77667b93 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] 10.222.0.53 "GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2" status: 200 len: 1314 microversion: 2.1 time: 0.847101 Aug 27 04:31:12.468288 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 23/51] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:31:11 2021] GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2 => generated 1314 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:31:13.031353 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-0b983e91-f358-44f0-ac6b-eb3aa2ed124b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1598201724", "imageRef": "9356e2fa-e55b-41d9-9ca4-53393f2d79fd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2d12ac97-d989-4330-872d-92f5fe3f8e57"}], "security_groups": [{"name": "tempest-securitygroup--123681874"}], "key_name": "tempest-keypair-839120903", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:13.046402 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-8bc40437-c89e-47e0-bb78-d175f85eb2ce tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:13.047377 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-8bc40437-c89e-47e0-bb78-d175f85eb2ce tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:13.059484 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8bc40437-c89e-47e0-bb78-d175f85eb2ce tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:13.060449 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8bc40437-c89e-47e0-bb78-d175f85eb2ce tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:13.061691 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8bc40437-c89e-47e0-bb78-d175f85eb2ce tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:13.064435 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8bc40437-c89e-47e0-bb78-d175f85eb2ce tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:13.340956 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.network.neutron [None req-0b983e91-f358-44f0-ac6b-eb3aa2ed124b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] validate_networks() for [('2d12ac97-d989-4330-872d-92f5fe3f8e57', None, None, None, None, None)] {{(pid=108970) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 04:31:13.399053 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-8bc40437-c89e-47e0-bb78-d175f85eb2ce tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:13.414602 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-8bc40437-c89e-47e0-bb78-d175f85eb2ce tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1296 microversion: 2.1 time: 0.387184 Aug 27 04:31:13.418611 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 24/52] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:31:13 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1296 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:13.485214 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-b71caecb-bb0c-46e9-90dd-7b10a2946d71 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:13.486513 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-b71caecb-bb0c-46e9-90dd-7b10a2946d71 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] [instance: a71f46a9-4083-4f82-99fe-e020c5d173c2] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:13.500969 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b71caecb-bb0c-46e9-90dd-7b10a2946d71 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:13.501846 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b71caecb-bb0c-46e9-90dd-7b10a2946d71 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:13.507753 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b71caecb-bb0c-46e9-90dd-7b10a2946d71 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:13.513390 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b71caecb-bb0c-46e9-90dd-7b10a2946d71 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:14.207653 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-b71caecb-bb0c-46e9-90dd-7b10a2946d71 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e934818a1e974ea1986b07a7d3e78cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90959ac150c48beb4feacbabf64500f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:14.239131 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-b71caecb-bb0c-46e9-90dd-7b10a2946d71 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] 10.222.0.53 "GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2" status: 200 len: 1314 microversion: 2.1 time: 0.751943 Aug 27 04:31:14.240928 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 25/53] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:31:13 2021] GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2 => generated 1314 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:31:14.436604 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-7e97bc01-2758-4f67-9c40-da71cfbc68fa tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:14.437630 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-7e97bc01-2758-4f67-9c40-da71cfbc68fa tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:14.457078 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7e97bc01-2758-4f67-9c40-da71cfbc68fa tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:14.460110 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7e97bc01-2758-4f67-9c40-da71cfbc68fa tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:14.462575 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7e97bc01-2758-4f67-9c40-da71cfbc68fa tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:14.463041 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7e97bc01-2758-4f67-9c40-da71cfbc68fa tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:14.675567 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-7e97bc01-2758-4f67-9c40-da71cfbc68fa tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:14.687704 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-7e97bc01-2758-4f67-9c40-da71cfbc68fa tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1296 microversion: 2.1 time: 0.255540 Aug 27 04:31:14.689274 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 26/54] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:31:14 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1296 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:15.259678 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-d0b51ac6-e78f-4b2b-ae46-b09a9fa58c1a tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:15.260325 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-d0b51ac6-e78f-4b2b-ae46-b09a9fa58c1a tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] [instance: a71f46a9-4083-4f82-99fe-e020c5d173c2] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:15.272359 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d0b51ac6-e78f-4b2b-ae46-b09a9fa58c1a tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:15.273456 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d0b51ac6-e78f-4b2b-ae46-b09a9fa58c1a tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:15.303111 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d0b51ac6-e78f-4b2b-ae46-b09a9fa58c1a tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:15.304442 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d0b51ac6-e78f-4b2b-ae46-b09a9fa58c1a tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:15.625276 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-d0b51ac6-e78f-4b2b-ae46-b09a9fa58c1a tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e934818a1e974ea1986b07a7d3e78cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90959ac150c48beb4feacbabf64500f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:15.669794 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-d0b51ac6-e78f-4b2b-ae46-b09a9fa58c1a tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] 10.222.0.53 "GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2" status: 200 len: 1314 microversion: 2.1 time: 0.405421 Aug 27 04:31:15.673001 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 27/55] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:31:15 2021] GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2 => generated 1314 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:31:15.711257 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-87581bfe-ec0e-411b-bde6-d5bf3dfa89b2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:15.713435 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-87581bfe-ec0e-411b-bde6-d5bf3dfa89b2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:15.738599 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-87581bfe-ec0e-411b-bde6-d5bf3dfa89b2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:15.739944 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-87581bfe-ec0e-411b-bde6-d5bf3dfa89b2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:15.744318 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-87581bfe-ec0e-411b-bde6-d5bf3dfa89b2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:15.745079 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-87581bfe-ec0e-411b-bde6-d5bf3dfa89b2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:15.918666 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-87581bfe-ec0e-411b-bde6-d5bf3dfa89b2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:15.943295 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-87581bfe-ec0e-411b-bde6-d5bf3dfa89b2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1296 microversion: 2.1 time: 0.236720 Aug 27 04:31:15.945813 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 28/56] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:31:15 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1296 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:31:16.069588 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.virt.hardware [None req-0b983e91-f358-44f0-ac6b-eb3aa2ed124b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Flavor limits 0:0:0 {{(pid=108970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:31:16.070186 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.virt.hardware [None req-0b983e91-f358-44f0-ac6b-eb3aa2ed124b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Image limits 0:0:0 {{(pid=108970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:31:16.070718 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.virt.hardware [None req-0b983e91-f358-44f0-ac6b-eb3aa2ed124b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Flavor pref 0:0:0 {{(pid=108970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:31:16.071950 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.virt.hardware [None req-0b983e91-f358-44f0-ac6b-eb3aa2ed124b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Image pref 0:0:0 {{(pid=108970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:31:16.072540 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.virt.hardware [None req-0b983e91-f358-44f0-ac6b-eb3aa2ed124b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:31:16.100256 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0b983e91-f358-44f0-ac6b-eb3aa2ed124b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:16.100681 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0b983e91-f358-44f0-ac6b-eb3aa2ed124b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:16.101603 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0b983e91-f358-44f0-ac6b-eb3aa2ed124b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:16.102290 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0b983e91-f358-44f0-ac6b-eb3aa2ed124b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:16.154470 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.quota [None req-0b983e91-f358-44f0-ac6b-eb3aa2ed124b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Getting quotas for project a6be58896fed46208a356cedf5a8513e. Resources: {'ram', 'cores', 'instances'} {{(pid=108970) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:31:16.165089 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.quota [None req-0b983e91-f358-44f0-ac6b-eb3aa2ed124b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Getting quotas for user ebedf95669444aa29994308a5f59ee2d and project a6be58896fed46208a356cedf5a8513e. Resources: {'ram', 'cores', 'instances'} {{(pid=108970) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:31:16.188758 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-0b983e91-f358-44f0-ac6b-eb3aa2ed124b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Going to run 1 instances... {{(pid=108970) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 04:31:16.191805 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-0b983e91-f358-44f0-ac6b-eb3aa2ed124b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9356e2fa-e55b-41d9-9ca4-53393f2d79fd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 04:31:16.354715 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-0b983e91-f358-44f0-ac6b-eb3aa2ed124b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.329772 Aug 27 04:31:16.362532 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 29/57] 10.222.0.53 () {62 vars in 1188 bytes} [Fri Aug 27 04:31:13 2021] POST /compute/v2.1/servers => generated 401 bytes in 3333 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 04:31:16.387253 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-1f6eab31-74f9-4677-9d39-37498f0dfde3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:16.387928 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-1f6eab31-74f9-4677-9d39-37498f0dfde3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:16.510150 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-1f6eab31-74f9-4677-9d39-37498f0dfde3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:16.522346 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-1f6eab31-74f9-4677-9d39-37498f0dfde3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:16.530340 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-1f6eab31-74f9-4677-9d39-37498f0dfde3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:16.534424 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-1f6eab31-74f9-4677-9d39-37498f0dfde3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1281 microversion: 2.20 time: 0.168596 Aug 27 04:31:16.537163 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 29/58] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:31:16 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1281 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:31:16.693469 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-8f96a7ea-e57b-4dd5-8bf2-0a08bd08a084 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:16.694162 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-8f96a7ea-e57b-4dd5-8bf2-0a08bd08a084 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] [instance: a71f46a9-4083-4f82-99fe-e020c5d173c2] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:16.705046 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-8f96a7ea-e57b-4dd5-8bf2-0a08bd08a084 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:16.706828 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-8f96a7ea-e57b-4dd5-8bf2-0a08bd08a084 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:16.708843 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-8f96a7ea-e57b-4dd5-8bf2-0a08bd08a084 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:16.722447 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-8f96a7ea-e57b-4dd5-8bf2-0a08bd08a084 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:16.968853 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-cde51308-1c44-40a3-8482-c76a32d1c9c5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:16.969543 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-cde51308-1c44-40a3-8482-c76a32d1c9c5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:16.998490 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cde51308-1c44-40a3-8482-c76a32d1c9c5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:17.000524 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cde51308-1c44-40a3-8482-c76a32d1c9c5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:17.003924 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cde51308-1c44-40a3-8482-c76a32d1c9c5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:17.006033 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cde51308-1c44-40a3-8482-c76a32d1c9c5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:17.346363 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-cde51308-1c44-40a3-8482-c76a32d1c9c5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:17.355961 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-cde51308-1c44-40a3-8482-c76a32d1c9c5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1363 microversion: 2.1 time: 0.392071 Aug 27 04:31:17.358089 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 30/59] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:31:16 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1363 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:17.563881 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-f7ba7102-2236-4103-813f-13c47c4a7023 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:17.564529 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-f7ba7102-2236-4103-813f-13c47c4a7023 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:17.575297 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f7ba7102-2236-4103-813f-13c47c4a7023 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:17.575759 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f7ba7102-2236-4103-813f-13c47c4a7023 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:17.577517 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f7ba7102-2236-4103-813f-13c47c4a7023 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:17.577517 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f7ba7102-2236-4103-813f-13c47c4a7023 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:17.665071 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-8f96a7ea-e57b-4dd5-8bf2-0a08bd08a084 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e934818a1e974ea1986b07a7d3e78cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90959ac150c48beb4feacbabf64500f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:17.696454 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-8f96a7ea-e57b-4dd5-8bf2-0a08bd08a084 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] 10.222.0.53 "GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2" status: 200 len: 1314 microversion: 2.1 time: 1.008655 Aug 27 04:31:17.714753 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-f7ba7102-2236-4103-813f-13c47c4a7023 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:17.715781 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-f7ba7102-2236-4103-813f-13c47c4a7023 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:17.717504 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 30/60] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:31:16 2021] GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2 => generated 1314 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:17.719345 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-f7ba7102-2236-4103-813f-13c47c4a7023 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:17.721003 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-f7ba7102-2236-4103-813f-13c47c4a7023 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1285 microversion: 2.20 time: 0.161192 Aug 27 04:31:17.729752 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 31/61] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:31:17 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1285 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:31:18.376091 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-1c6052e3-e78d-4126-8815-0bc733352bb0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:18.376730 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-1c6052e3-e78d-4126-8815-0bc733352bb0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:18.384471 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1c6052e3-e78d-4126-8815-0bc733352bb0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:18.385698 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1c6052e3-e78d-4126-8815-0bc733352bb0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:18.387392 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1c6052e3-e78d-4126-8815-0bc733352bb0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:18.389495 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1c6052e3-e78d-4126-8815-0bc733352bb0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:18.912384 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-1c6052e3-e78d-4126-8815-0bc733352bb0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:18.942112 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-1c6052e3-e78d-4126-8815-0bc733352bb0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1363 microversion: 2.1 time: 0.565953 Aug 27 04:31:18.944087 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 31/62] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:31:18 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1363 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:18.954904 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-f4f95294-5cd1-4f8d-8fa1-756404c5885b tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:18.956997 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-f4f95294-5cd1-4f8d-8fa1-756404c5885b tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] [instance: a71f46a9-4083-4f82-99fe-e020c5d173c2] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:18.970050 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f4f95294-5cd1-4f8d-8fa1-756404c5885b tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:18.972052 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f4f95294-5cd1-4f8d-8fa1-756404c5885b tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:18.973947 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f4f95294-5cd1-4f8d-8fa1-756404c5885b tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:18.974967 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f4f95294-5cd1-4f8d-8fa1-756404c5885b tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:19.318219 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [req-24b60266-ff54-4cbe-818e-61ee31bcc507 req-26b2a7c7-90c1-4680-af13-08eb73e53864 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a71f46a9-4083-4f82-99fe-e020c5d173c2", "tag": "901b4a6c-2cea-4fb7-b496-26f960e19750"}]} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:19.322783 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:31:19.322783 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: warnings.warn(msg) Aug 27 04:31:19.354093 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-24b60266-ff54-4cbe-818e-61ee31bcc507 req-26b2a7c7-90c1-4680-af13-08eb73e53864 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:19.360347 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-24b60266-ff54-4cbe-818e-61ee31bcc507 req-26b2a7c7-90c1-4680-af13-08eb73e53864 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:19.424819 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.compute.server_external_events [req-24b60266-ff54-4cbe-818e-61ee31bcc507 req-26b2a7c7-90c1-4680-af13-08eb73e53864 service nova] Creating event network-changed:901b4a6c-2cea-4fb7-b496-26f960e19750 for instance a71f46a9-4083-4f82-99fe-e020c5d173c2 on hv-cinder-80403 Aug 27 04:31:19.425340 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-24b60266-ff54-4cbe-818e-61ee31bcc507 req-26b2a7c7-90c1-4680-af13-08eb73e53864 service nova] Acquired lock "compute-rpcapi-router" {{(pid=108971) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Aug 27 04:31:19.426584 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-78f35430-42b7-495c-a93e-c1829dd7d35d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:19.427115 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-78f35430-42b7-495c-a93e-c1829dd7d35d None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:19.427864 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-78f35430-42b7-495c-a93e-c1829dd7d35d None None] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:19.428344 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-78f35430-42b7-495c-a93e-c1829dd7d35d None None] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:19.453509 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.compute.rpcapi [None req-78f35430-42b7-495c-a93e-c1829dd7d35d None None] Automatically selected compute RPC version 6.0 from minimum service version 57 Aug 27 04:31:19.456866 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-78f35430-42b7-495c-a93e-c1829dd7d35d None None] Releasing lock "compute-rpcapi-router" {{(pid=108971) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Aug 27 04:31:19.532551 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-78f35430-42b7-495c-a93e-c1829dd7d35d None None] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.942090 Aug 27 04:31:19.533708 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 32/63] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:31:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:31:19.539436 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-e9222e74-6ac6-47ec-b2c6-699713c610c9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:19.548109 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-e9222e74-6ac6-47ec-b2c6-699713c610c9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:19.563721 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e9222e74-6ac6-47ec-b2c6-699713c610c9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:19.564529 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e9222e74-6ac6-47ec-b2c6-699713c610c9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:19.566092 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e9222e74-6ac6-47ec-b2c6-699713c610c9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:19.567229 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e9222e74-6ac6-47ec-b2c6-699713c610c9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:19.726912 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-e9222e74-6ac6-47ec-b2c6-699713c610c9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:19.744158 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-e9222e74-6ac6-47ec-b2c6-699713c610c9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:19.750136 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-e9222e74-6ac6-47ec-b2c6-699713c610c9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:19.754849 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-e9222e74-6ac6-47ec-b2c6-699713c610c9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1333 microversion: 2.20 time: 0.218958 Aug 27 04:31:19.757359 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 33/64] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:31:19 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1333 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:31:19.964026 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-78f8c550-12ce-43a8-981f-7d784573d7ae tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:19.965306 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-78f8c550-12ce-43a8-981f-7d784573d7ae tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:19.979067 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-78f8c550-12ce-43a8-981f-7d784573d7ae tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:19.980227 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-78f8c550-12ce-43a8-981f-7d784573d7ae tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:19.982538 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-78f8c550-12ce-43a8-981f-7d784573d7ae tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:19.984393 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-78f8c550-12ce-43a8-981f-7d784573d7ae tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:20.228412 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-f4f95294-5cd1-4f8d-8fa1-756404c5885b tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e934818a1e974ea1986b07a7d3e78cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90959ac150c48beb4feacbabf64500f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:20.242398 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-f4f95294-5cd1-4f8d-8fa1-756404c5885b tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] 10.222.0.53 "GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2" status: 200 len: 1314 microversion: 2.1 time: 1.295313 Aug 27 04:31:20.251643 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 32/65] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:31:18 2021] GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2 => generated 1314 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:20.438179 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-78f8c550-12ce-43a8-981f-7d784573d7ae tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:20.450394 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-78f8c550-12ce-43a8-981f-7d784573d7ae tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1363 microversion: 2.1 time: 0.487504 Aug 27 04:31:20.463279 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 34/66] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:31:19 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1363 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:31:20.779182 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-978a131b-6664-4763-afed-a9c4e22b2918 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:20.780624 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-978a131b-6664-4763-afed-a9c4e22b2918 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:20.789671 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-978a131b-6664-4763-afed-a9c4e22b2918 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:20.791366 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-978a131b-6664-4763-afed-a9c4e22b2918 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:20.793279 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-978a131b-6664-4763-afed-a9c4e22b2918 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:20.794207 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-978a131b-6664-4763-afed-a9c4e22b2918 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:20.935372 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-978a131b-6664-4763-afed-a9c4e22b2918 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:20.953726 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-978a131b-6664-4763-afed-a9c4e22b2918 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:20.955629 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-978a131b-6664-4763-afed-a9c4e22b2918 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:20.960623 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-978a131b-6664-4763-afed-a9c4e22b2918 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1351 microversion: 2.20 time: 0.188002 Aug 27 04:31:20.963355 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 33/67] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:31:20 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1351 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:31:21.271961 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-7d6f11bd-4087-4a8f-8839-96a0ce13c426 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:21.275367 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-7d6f11bd-4087-4a8f-8839-96a0ce13c426 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] [instance: a71f46a9-4083-4f82-99fe-e020c5d173c2] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:21.287908 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7d6f11bd-4087-4a8f-8839-96a0ce13c426 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:21.298852 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7d6f11bd-4087-4a8f-8839-96a0ce13c426 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:21.300593 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7d6f11bd-4087-4a8f-8839-96a0ce13c426 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:21.303549 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7d6f11bd-4087-4a8f-8839-96a0ce13c426 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:21.464715 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-05f6eff0-f1cd-4179-9cd3-b5604fe92abd tempest-VolumesTestJSON-1477282156 tempest-VolumesTestJSON-1477282156-project] Calling method '.version_select at 0x7f20781b1310>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:21.520804 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-7d6f11bd-4087-4a8f-8839-96a0ce13c426 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e934818a1e974ea1986b07a7d3e78cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90959ac150c48beb4feacbabf64500f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:21.542103 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-7d6f11bd-4087-4a8f-8839-96a0ce13c426 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] 10.222.0.53 "GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2" status: 200 len: 1314 microversion: 2.1 time: 0.273046 Aug 27 04:31:21.562162 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 35/68] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:31:21 2021] GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:21.589083 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-0caf7120-a4b3-48b2-8c40-2eee335cca13 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:21.591286 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-0caf7120-a4b3-48b2-8c40-2eee335cca13 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:21.611233 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0caf7120-a4b3-48b2-8c40-2eee335cca13 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:21.612323 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0caf7120-a4b3-48b2-8c40-2eee335cca13 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:21.613923 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0caf7120-a4b3-48b2-8c40-2eee335cca13 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:21.614927 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0caf7120-a4b3-48b2-8c40-2eee335cca13 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:21.615080 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-05f6eff0-f1cd-4179-9cd3-b5604fe92abd tempest-VolumesTestJSON-1477282156 tempest-VolumesTestJSON-1477282156-project] 10.222.0.53 "GET /compute/v2.1/os-volumes/8d9967e6-791c-4964-9748-f480efceaa20" status: 200 len: 351 microversion: 2.1 time: 0.157159 Aug 27 04:31:21.615952 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 34/69] 10.222.0.53 () {58 vars in 1245 bytes} [Fri Aug 27 04:31:21 2021] GET /compute/v2.1/os-volumes/8d9967e6-791c-4964-9748-f480efceaa20 => generated 351 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:31:21.631424 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [req-0904b711-14c8-44c1-b93a-7f2f2e14c630 req-00e6db0e-4773-4395-a06f-6c17482accd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5598e9e1-bc44-4831-be1a-f478deba899b", "tag": "f8a58c4d-0881-4c48-9ebe-4070da2b40d9"}]} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:21.633718 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:31:21.633718 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: warnings.warn(msg) Aug 27 04:31:21.688586 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-0904b711-14c8-44c1-b93a-7f2f2e14c630 req-00e6db0e-4773-4395-a06f-6c17482accd0 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:21.689196 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-0904b711-14c8-44c1-b93a-7f2f2e14c630 req-00e6db0e-4773-4395-a06f-6c17482accd0 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:21.772343 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.compute.server_external_events [req-0904b711-14c8-44c1-b93a-7f2f2e14c630 req-00e6db0e-4773-4395-a06f-6c17482accd0 service nova] Creating event network-changed:f8a58c4d-0881-4c48-9ebe-4070da2b40d9 for instance 5598e9e1-bc44-4831-be1a-f478deba899b on hv-cinder-80403 Aug 27 04:31:21.772909 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-0904b711-14c8-44c1-b93a-7f2f2e14c630 req-00e6db0e-4773-4395-a06f-6c17482accd0 service nova] Acquired lock "compute-rpcapi-router" {{(pid=108970) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Aug 27 04:31:21.780667 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b86a00f2-156a-426f-b5c2-c0ffd010c784 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:21.782743 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b86a00f2-156a-426f-b5c2-c0ffd010c784 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:21.786685 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b86a00f2-156a-426f-b5c2-c0ffd010c784 None None] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:21.787367 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b86a00f2-156a-426f-b5c2-c0ffd010c784 None None] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:21.827585 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.compute.rpcapi [None req-b86a00f2-156a-426f-b5c2-c0ffd010c784 None None] Automatically selected compute RPC version 6.0 from minimum service version 57 Aug 27 04:31:21.831532 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b86a00f2-156a-426f-b5c2-c0ffd010c784 None None] Releasing lock "compute-rpcapi-router" {{(pid=108970) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Aug 27 04:31:21.900818 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-0caf7120-a4b3-48b2-8c40-2eee335cca13 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:21.911001 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-0caf7120-a4b3-48b2-8c40-2eee335cca13 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1363 microversion: 2.1 time: 0.337921 Aug 27 04:31:21.913323 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 36/70] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:31:21 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1363 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:21.920404 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-b86a00f2-156a-426f-b5c2-c0ffd010c784 None None] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.289717 Aug 27 04:31:21.922289 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 35/71] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:31:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:31:21.988364 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-3dc9e1b2-35e0-4f31-b36c-64f7151a7588 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:21.989374 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-3dc9e1b2-35e0-4f31-b36c-64f7151a7588 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:22.021679 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3dc9e1b2-35e0-4f31-b36c-64f7151a7588 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:22.022660 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3dc9e1b2-35e0-4f31-b36c-64f7151a7588 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:22.023706 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3dc9e1b2-35e0-4f31-b36c-64f7151a7588 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:22.024396 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3dc9e1b2-35e0-4f31-b36c-64f7151a7588 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:22.160669 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-3dc9e1b2-35e0-4f31-b36c-64f7151a7588 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:22.171630 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-3dc9e1b2-35e0-4f31-b36c-64f7151a7588 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:22.173194 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-3dc9e1b2-35e0-4f31-b36c-64f7151a7588 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:22.174300 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-3dc9e1b2-35e0-4f31-b36c-64f7151a7588 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1351 microversion: 2.20 time: 0.190891 Aug 27 04:31:22.181266 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 37/72] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:31:21 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1351 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:31:22.570019 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-ee2411ce-cfc6-496f-bfab-83f0c61df787 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:22.570676 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-ee2411ce-cfc6-496f-bfab-83f0c61df787 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] [instance: a71f46a9-4083-4f82-99fe-e020c5d173c2] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:22.588974 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ee2411ce-cfc6-496f-bfab-83f0c61df787 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:22.589282 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ee2411ce-cfc6-496f-bfab-83f0c61df787 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:22.590770 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ee2411ce-cfc6-496f-bfab-83f0c61df787 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:22.591212 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ee2411ce-cfc6-496f-bfab-83f0c61df787 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:22.865379 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-ee2411ce-cfc6-496f-bfab-83f0c61df787 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e934818a1e974ea1986b07a7d3e78cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90959ac150c48beb4feacbabf64500f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:22.883551 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-ee2411ce-cfc6-496f-bfab-83f0c61df787 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] 10.222.0.53 "GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2" status: 200 len: 1314 microversion: 2.1 time: 0.318708 Aug 27 04:31:22.886923 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 36/73] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:31:22 2021] GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2 => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:22.936023 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-dbfb7f64-fbb5-42b7-9942-435416483f4d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:22.937526 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-dbfb7f64-fbb5-42b7-9942-435416483f4d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:22.949002 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-dbfb7f64-fbb5-42b7-9942-435416483f4d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:22.949454 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-dbfb7f64-fbb5-42b7-9942-435416483f4d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:22.951825 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-dbfb7f64-fbb5-42b7-9942-435416483f4d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:22.959360 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-dbfb7f64-fbb5-42b7-9942-435416483f4d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:23.176558 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-dbfb7f64-fbb5-42b7-9942-435416483f4d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:23.193991 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-dbfb7f64-fbb5-42b7-9942-435416483f4d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1363 microversion: 2.1 time: 0.261329 Aug 27 04:31:23.204999 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 38/74] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:31:22 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1363 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:23.213434 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-5f9ee6c8-3d09-4453-8b49-f5238186346b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:23.214094 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-5f9ee6c8-3d09-4453-8b49-f5238186346b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:23.220885 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5f9ee6c8-3d09-4453-8b49-f5238186346b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:23.221494 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5f9ee6c8-3d09-4453-8b49-f5238186346b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:23.222310 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5f9ee6c8-3d09-4453-8b49-f5238186346b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:23.222755 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5f9ee6c8-3d09-4453-8b49-f5238186346b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:23.244572 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-7d84299f-f67e-40fc-b0d5-c118a1f22cda tempest-VolumesTestJSON-1477282156 tempest-VolumesTestJSON-1477282156-project] Calling method '.version_select at 0x7f20789e7c10>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:23.314624 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-5f9ee6c8-3d09-4453-8b49-f5238186346b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:23.328426 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-5f9ee6c8-3d09-4453-8b49-f5238186346b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:23.330383 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-5f9ee6c8-3d09-4453-8b49-f5238186346b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:23.331583 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-5f9ee6c8-3d09-4453-8b49-f5238186346b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1351 microversion: 2.20 time: 0.138421 Aug 27 04:31:23.332436 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 37/75] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:31:23 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1351 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:31:23.374167 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-7d84299f-f67e-40fc-b0d5-c118a1f22cda tempest-VolumesTestJSON-1477282156 tempest-VolumesTestJSON-1477282156-project] 10.222.0.53 "GET /compute/v2.1/os-volumes/8054c626-c9b5-47be-95ee-48dabd50a083" status: 200 len: 351 microversion: 2.1 time: 0.135677 Aug 27 04:31:23.375134 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 39/76] 10.222.0.53 () {58 vars in 1245 bytes} [Fri Aug 27 04:31:23 2021] GET /compute/v2.1/os-volumes/8054c626-c9b5-47be-95ee-48dabd50a083 => generated 351 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:31:23.905634 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-715a8e9b-b147-49c1-a46b-ecbc29f73c4c tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:23.906882 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-715a8e9b-b147-49c1-a46b-ecbc29f73c4c tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] [instance: a71f46a9-4083-4f82-99fe-e020c5d173c2] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:23.917264 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-715a8e9b-b147-49c1-a46b-ecbc29f73c4c tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:23.918480 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-715a8e9b-b147-49c1-a46b-ecbc29f73c4c tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:23.919450 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-715a8e9b-b147-49c1-a46b-ecbc29f73c4c tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:23.920081 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-715a8e9b-b147-49c1-a46b-ecbc29f73c4c tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:24.118801 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-715a8e9b-b147-49c1-a46b-ecbc29f73c4c tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e934818a1e974ea1986b07a7d3e78cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90959ac150c48beb4feacbabf64500f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:24.134748 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-715a8e9b-b147-49c1-a46b-ecbc29f73c4c tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] 10.222.0.53 "GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2" status: 200 len: 1314 microversion: 2.1 time: 0.232202 Aug 27 04:31:24.136260 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 38/77] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:31:23 2021] GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:24.211547 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-f1eaa248-5202-4f97-963a-c02d48f58923 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:24.213020 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-f1eaa248-5202-4f97-963a-c02d48f58923 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:24.219152 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f1eaa248-5202-4f97-963a-c02d48f58923 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:24.219756 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f1eaa248-5202-4f97-963a-c02d48f58923 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:24.220668 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f1eaa248-5202-4f97-963a-c02d48f58923 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:24.221230 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f1eaa248-5202-4f97-963a-c02d48f58923 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:24.351809 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-a6efd4d9-cc9b-4adb-aae9-68e5026ded84 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:24.352681 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-a6efd4d9-cc9b-4adb-aae9-68e5026ded84 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:24.361986 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a6efd4d9-cc9b-4adb-aae9-68e5026ded84 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:24.362493 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a6efd4d9-cc9b-4adb-aae9-68e5026ded84 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:24.363361 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a6efd4d9-cc9b-4adb-aae9-68e5026ded84 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:24.363911 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a6efd4d9-cc9b-4adb-aae9-68e5026ded84 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:24.411363 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-f1eaa248-5202-4f97-963a-c02d48f58923 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:24.419461 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-f1eaa248-5202-4f97-963a-c02d48f58923 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1363 microversion: 2.1 time: 0.211452 Aug 27 04:31:24.420055 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 40/78] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:31:24 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1363 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:24.460728 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-a6efd4d9-cc9b-4adb-aae9-68e5026ded84 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:24.470341 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-a6efd4d9-cc9b-4adb-aae9-68e5026ded84 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:24.471871 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-a6efd4d9-cc9b-4adb-aae9-68e5026ded84 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:24.473003 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-a6efd4d9-cc9b-4adb-aae9-68e5026ded84 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1351 microversion: 2.20 time: 0.125720 Aug 27 04:31:24.473568 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 39/79] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:31:24 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1351 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:31:24.963630 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-6b48705f-547a-4789-a38d-bae692b438ba tempest-VolumesTestJSON-1477282156 tempest-VolumesTestJSON-1477282156-project] Calling method '.version_select at 0x7f2079b10790>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:25.058740 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-6b48705f-547a-4789-a38d-bae692b438ba tempest-VolumesTestJSON-1477282156 tempest-VolumesTestJSON-1477282156-project] 10.222.0.53 "GET /compute/v2.1/os-volumes/a1c99b5c-931b-4a78-82a9-f07c747b0961" status: 200 len: 351 microversion: 2.1 time: 0.100253 Aug 27 04:31:25.066435 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 41/80] 10.222.0.53 () {58 vars in 1245 bytes} [Fri Aug 27 04:31:24 2021] GET /compute/v2.1/os-volumes/a1c99b5c-931b-4a78-82a9-f07c747b0961 => generated 351 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:31:25.076143 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-ed59ee0c-c3eb-4796-bf51-3ca9d2e0c960 tempest-VolumesTestJSON-1477282156 tempest-VolumesTestJSON-1477282156-project] Calling method '.version_select at 0x7f2078186ee0>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:25.161411 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-7df8db81-a907-43e5-bda9-7015f7b99ce7 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:25.162083 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-7df8db81-a907-43e5-bda9-7015f7b99ce7 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] [instance: a71f46a9-4083-4f82-99fe-e020c5d173c2] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:25.172399 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7df8db81-a907-43e5-bda9-7015f7b99ce7 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:25.173112 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7df8db81-a907-43e5-bda9-7015f7b99ce7 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:25.174069 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7df8db81-a907-43e5-bda9-7015f7b99ce7 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:25.174662 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7df8db81-a907-43e5-bda9-7015f7b99ce7 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:25.214465 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-ed59ee0c-c3eb-4796-bf51-3ca9d2e0c960 tempest-VolumesTestJSON-1477282156 tempest-VolumesTestJSON-1477282156-project] 10.222.0.53 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.145700 Aug 27 04:31:25.215949 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 40/81] 10.222.0.53 () {58 vars in 1134 bytes} [Fri Aug 27 04:31:25 2021] GET /compute/v2.1/os-volumes => generated 1036 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:25.234111 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-68be2d08-6e30-4a7f-aa7f-0c9f57b4eb42 tempest-VolumesTestJSON-1477282156 tempest-VolumesTestJSON-1477282156-project] Calling method '.version_select at 0x7f20781b1040>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:25.368467 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-68be2d08-6e30-4a7f-aa7f-0c9f57b4eb42 tempest-VolumesTestJSON-1477282156 tempest-VolumesTestJSON-1477282156-project] 10.222.0.53 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.140763 Aug 27 04:31:25.368467 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 41/82] 10.222.0.53 () {58 vars in 1149 bytes} [Fri Aug 27 04:31:25 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:31:25.391133 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-16952c8a-fdb1-4359-b04b-528d2006e2fe tempest-VolumesTestJSON-1477282156 tempest-VolumesTestJSON-1477282156-project] Calling method '.version_select at 0x7f20781fb790>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:25.429252 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-7df8db81-a907-43e5-bda9-7015f7b99ce7 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e934818a1e974ea1986b07a7d3e78cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90959ac150c48beb4feacbabf64500f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:25.442026 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-7df8db81-a907-43e5-bda9-7015f7b99ce7 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] 10.222.0.53 "GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2" status: 200 len: 1314 microversion: 2.1 time: 0.289607 Aug 27 04:31:25.443509 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 42/83] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:31:25 2021] GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2 => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:31:25.447871 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-be8ce5cf-c392-4b1e-a85f-d1d6820cada0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:25.448586 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-be8ce5cf-c392-4b1e-a85f-d1d6820cada0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:25.456258 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-be8ce5cf-c392-4b1e-a85f-d1d6820cada0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:25.456958 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-be8ce5cf-c392-4b1e-a85f-d1d6820cada0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:25.458418 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-be8ce5cf-c392-4b1e-a85f-d1d6820cada0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:25.459010 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-be8ce5cf-c392-4b1e-a85f-d1d6820cada0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:25.614415 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-16952c8a-fdb1-4359-b04b-528d2006e2fe tempest-VolumesTestJSON-1477282156 tempest-VolumesTestJSON-1477282156-project] 10.222.0.53 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.228025 Aug 27 04:31:25.615000 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 42/84] 10.222.0.53 () {58 vars in 1134 bytes} [Fri Aug 27 04:31:25 2021] GET /compute/v2.1/os-volumes => generated 1036 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:25.622213 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-35be9393-0ad0-4487-9b41-0c41fb41dc92 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:25.622213 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-35be9393-0ad0-4487-9b41-0c41fb41dc92 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:25.633558 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-35be9393-0ad0-4487-9b41-0c41fb41dc92 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:25.639620 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-35be9393-0ad0-4487-9b41-0c41fb41dc92 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:25.640697 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-35be9393-0ad0-4487-9b41-0c41fb41dc92 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:25.641156 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-35be9393-0ad0-4487-9b41-0c41fb41dc92 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:25.753270 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-be8ce5cf-c392-4b1e-a85f-d1d6820cada0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:25.760389 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-35be9393-0ad0-4487-9b41-0c41fb41dc92 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:25.761146 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-be8ce5cf-c392-4b1e-a85f-d1d6820cada0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1363 microversion: 2.1 time: 0.316872 Aug 27 04:31:25.766755 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 43/85] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:31:25 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1363 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:25.771369 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-7e4d6c88-5d9b-457c-90f4-643e18db65db tempest-VolumesTestJSON-1477282156 tempest-VolumesTestJSON-1477282156-project] Calling method '.version_select at 0x7f2079b10670>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:25.779004 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-35be9393-0ad0-4487-9b41-0c41fb41dc92 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:25.780540 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-35be9393-0ad0-4487-9b41-0c41fb41dc92 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:25.781670 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-35be9393-0ad0-4487-9b41-0c41fb41dc92 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1339 microversion: 2.20 time: 0.165684 Aug 27 04:31:25.794491 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 43/86] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:31:25 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1339 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:31:25.901921 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-7e4d6c88-5d9b-457c-90f4-643e18db65db tempest-VolumesTestJSON-1477282156 tempest-VolumesTestJSON-1477282156-project] 10.222.0.53 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.134028 Aug 27 04:31:25.902792 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 44/87] 10.222.0.53 () {58 vars in 1167 bytes} [Fri Aug 27 04:31:25 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:31:25.916562 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-81bf0e91-122f-42a1-9fbc-ec985a89840a tempest-VolumesTestJSON-1477282156 tempest-VolumesTestJSON-1477282156-project] Calling method '.version_select at 0x7f20781fbf70>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:26.043069 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-81bf0e91-122f-42a1-9fbc-ec985a89840a tempest-VolumesTestJSON-1477282156 tempest-VolumesTestJSON-1477282156-project] 10.222.0.53 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.131550 Aug 27 04:31:26.044072 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 44/88] 10.222.0.53 () {58 vars in 1170 bytes} [Fri Aug 27 04:31:25 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:31:26.066444 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-11ea368d-5649-473a-8bb0-8b85b00779d1 tempest-VolumesTestJSON-1477282156 tempest-VolumesTestJSON-1477282156-project] Calling method '.version_select at 0x7f20789f9310>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:26.209048 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-11ea368d-5649-473a-8bb0-8b85b00779d1 tempest-VolumesTestJSON-1477282156 tempest-VolumesTestJSON-1477282156-project] 10.222.0.53 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.155747 Aug 27 04:31:26.210649 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 45/89] 10.222.0.53 () {58 vars in 1155 bytes} [Fri Aug 27 04:31:26 2021] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:26.230537 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-9026db98-e264-4e22-ab77-68fdd2d1bad7 tempest-VolumesTestJSON-1477282156 tempest-VolumesTestJSON-1477282156-project] Calling method '.version_select at 0x7f20781c5ee0>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:26.432214 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-9026db98-e264-4e22-ab77-68fdd2d1bad7 tempest-VolumesTestJSON-1477282156 tempest-VolumesTestJSON-1477282156-project] 10.222.0.53 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.212798 Aug 27 04:31:26.433390 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 45/90] 10.222.0.53 () {58 vars in 1188 bytes} [Fri Aug 27 04:31:26 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:31:26.444966 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-76ea442c-5066-4651-b6cf-83fa2f0064ee tempest-VolumesTestJSON-1477282156 tempest-VolumesTestJSON-1477282156-project] Calling method '.version_select at 0x7f2078954280>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:26.462505 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-9590c041-9dba-4e6d-800d-6b44d99b1857 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:26.463527 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-9590c041-9dba-4e6d-800d-6b44d99b1857 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] [instance: a71f46a9-4083-4f82-99fe-e020c5d173c2] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:26.478748 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9590c041-9dba-4e6d-800d-6b44d99b1857 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:26.479726 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9590c041-9dba-4e6d-800d-6b44d99b1857 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:26.482813 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9590c041-9dba-4e6d-800d-6b44d99b1857 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:26.484921 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9590c041-9dba-4e6d-800d-6b44d99b1857 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:26.681154 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-76ea442c-5066-4651-b6cf-83fa2f0064ee tempest-VolumesTestJSON-1477282156 tempest-VolumesTestJSON-1477282156-project] 10.222.0.53 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.239735 Aug 27 04:31:26.682009 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 46/91] 10.222.0.53 () {58 vars in 1155 bytes} [Fri Aug 27 04:31:26 2021] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:26.782501 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-084f958e-4aaa-4d18-bc21-e6bc2e91c14c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:26.783429 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-084f958e-4aaa-4d18-bc21-e6bc2e91c14c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:26.793542 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-084f958e-4aaa-4d18-bc21-e6bc2e91c14c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:26.794213 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-084f958e-4aaa-4d18-bc21-e6bc2e91c14c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:26.795937 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-084f958e-4aaa-4d18-bc21-e6bc2e91c14c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:26.797657 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-084f958e-4aaa-4d18-bc21-e6bc2e91c14c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:27.381758 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-084f958e-4aaa-4d18-bc21-e6bc2e91c14c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:27.392847 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-084f958e-4aaa-4d18-bc21-e6bc2e91c14c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1363 microversion: 2.1 time: 0.614475 Aug 27 04:31:27.396704 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 47/92] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:31:26 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1363 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:27.402953 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-1f34be1e-5354-494e-80bf-dcb8cfbad3a4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:27.411384 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-1f34be1e-5354-494e-80bf-dcb8cfbad3a4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:27.421126 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1f34be1e-5354-494e-80bf-dcb8cfbad3a4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:27.426051 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1f34be1e-5354-494e-80bf-dcb8cfbad3a4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:27.426885 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1f34be1e-5354-494e-80bf-dcb8cfbad3a4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:27.427327 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1f34be1e-5354-494e-80bf-dcb8cfbad3a4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:27.523139 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-9590c041-9dba-4e6d-800d-6b44d99b1857 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e934818a1e974ea1986b07a7d3e78cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90959ac150c48beb4feacbabf64500f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:27.535654 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-9590c041-9dba-4e6d-800d-6b44d99b1857 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] 10.222.0.53 "GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2" status: 200 len: 1314 microversion: 2.1 time: 1.079701 Aug 27 04:31:27.537728 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 46/93] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:31:26 2021] GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2 => generated 1314 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:31:28.018852 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-1f34be1e-5354-494e-80bf-dcb8cfbad3a4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:28.052440 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-1f34be1e-5354-494e-80bf-dcb8cfbad3a4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:28.061314 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-1f34be1e-5354-494e-80bf-dcb8cfbad3a4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:28.061984 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-1f34be1e-5354-494e-80bf-dcb8cfbad3a4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1406 microversion: 2.20 time: 0.664229 Aug 27 04:31:28.064954 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 48/94] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:31:27 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1406 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:31:28.422899 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-fda36644-8805-45e5-8fe6-ef35ca429152 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:28.428915 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-fda36644-8805-45e5-8fe6-ef35ca429152 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:28.460608 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fda36644-8805-45e5-8fe6-ef35ca429152 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:28.463332 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fda36644-8805-45e5-8fe6-ef35ca429152 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:28.464759 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fda36644-8805-45e5-8fe6-ef35ca429152 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:28.467849 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fda36644-8805-45e5-8fe6-ef35ca429152 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:28.562784 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-3519cc70-d478-4945-bb50-6b9196e28f17 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:28.563367 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-3519cc70-d478-4945-bb50-6b9196e28f17 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] [instance: a71f46a9-4083-4f82-99fe-e020c5d173c2] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:28.571106 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3519cc70-d478-4945-bb50-6b9196e28f17 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:28.571566 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3519cc70-d478-4945-bb50-6b9196e28f17 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:28.572876 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3519cc70-d478-4945-bb50-6b9196e28f17 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:28.573315 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3519cc70-d478-4945-bb50-6b9196e28f17 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:28.702323 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-fda36644-8805-45e5-8fe6-ef35ca429152 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:28.717195 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-fda36644-8805-45e5-8fe6-ef35ca429152 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1363 microversion: 2.1 time: 0.306520 Aug 27 04:31:28.719499 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 47/95] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:31:28 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1363 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:28.892976 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-3519cc70-d478-4945-bb50-6b9196e28f17 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e934818a1e974ea1986b07a7d3e78cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90959ac150c48beb4feacbabf64500f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:28.904402 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-3519cc70-d478-4945-bb50-6b9196e28f17 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] 10.222.0.53 "GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2" status: 200 len: 1314 microversion: 2.1 time: 0.346784 Aug 27 04:31:28.915246 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 49/96] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:31:28 2021] GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2 => generated 1314 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:29.084514 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-4e5dc76d-d5da-4600-9962-94b338863836 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:29.085613 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-4e5dc76d-d5da-4600-9962-94b338863836 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:29.093706 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4e5dc76d-d5da-4600-9962-94b338863836 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:29.094253 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4e5dc76d-d5da-4600-9962-94b338863836 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:29.095493 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4e5dc76d-d5da-4600-9962-94b338863836 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:29.096319 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4e5dc76d-d5da-4600-9962-94b338863836 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:29.413881 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-4e5dc76d-d5da-4600-9962-94b338863836 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:29.429569 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-4e5dc76d-d5da-4600-9962-94b338863836 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:29.439799 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [req-9279735d-53f8-40b1-ba80-321e9025e9f0 req-cf9d9b28-56a1-4164-877c-d4ab1e74e792 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3173859-725e-4d66-80af-4223a6643935", "tag": "698af269-46a5-4892-822b-9ef4aa21fa2e"}]} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:29.443088 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:31:29.443088 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: warnings.warn(msg) Aug 27 04:31:29.450625 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-4e5dc76d-d5da-4600-9962-94b338863836 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:29.453369 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-4e5dc76d-d5da-4600-9962-94b338863836 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1406 microversion: 2.20 time: 0.372474 Aug 27 04:31:29.467411 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 48/97] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:31:29 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1406 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:31:29.474889 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-9279735d-53f8-40b1-ba80-321e9025e9f0 req-cf9d9b28-56a1-4164-877c-d4ab1e74e792 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:29.476170 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-9279735d-53f8-40b1-ba80-321e9025e9f0 req-cf9d9b28-56a1-4164-877c-d4ab1e74e792 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:29.506468 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.compute.server_external_events [req-9279735d-53f8-40b1-ba80-321e9025e9f0 req-cf9d9b28-56a1-4164-877c-d4ab1e74e792 service nova] Creating event network-changed:698af269-46a5-4892-822b-9ef4aa21fa2e for instance b3173859-725e-4d66-80af-4223a6643935 on hv-cinder-80403 Aug 27 04:31:29.521850 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [req-9279735d-53f8-40b1-ba80-321e9025e9f0 req-cf9d9b28-56a1-4164-877c-d4ab1e74e792 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.278674 Aug 27 04:31:29.522468 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 50/98] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:31:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:31:29.738676 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-b4607bde-6d78-48a8-9b1a-5419d9194a8d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:29.739773 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-b4607bde-6d78-48a8-9b1a-5419d9194a8d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:29.758929 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b4607bde-6d78-48a8-9b1a-5419d9194a8d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:29.765853 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b4607bde-6d78-48a8-9b1a-5419d9194a8d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:29.767254 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b4607bde-6d78-48a8-9b1a-5419d9194a8d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:29.774835 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b4607bde-6d78-48a8-9b1a-5419d9194a8d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:29.924513 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-65f57669-e07d-45a3-baac-d0cf3703f2a2 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:29.925735 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-65f57669-e07d-45a3-baac-d0cf3703f2a2 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] [instance: a71f46a9-4083-4f82-99fe-e020c5d173c2] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:29.943202 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-65f57669-e07d-45a3-baac-d0cf3703f2a2 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:29.945510 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-65f57669-e07d-45a3-baac-d0cf3703f2a2 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:29.949534 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-65f57669-e07d-45a3-baac-d0cf3703f2a2 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:29.951638 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-65f57669-e07d-45a3-baac-d0cf3703f2a2 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:30.119011 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-b4607bde-6d78-48a8-9b1a-5419d9194a8d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:30.128413 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-b4607bde-6d78-48a8-9b1a-5419d9194a8d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1363 microversion: 2.1 time: 0.396282 Aug 27 04:31:30.140453 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 49/99] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:31:29 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1363 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:31:30.362086 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-65f57669-e07d-45a3-baac-d0cf3703f2a2 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e934818a1e974ea1986b07a7d3e78cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90959ac150c48beb4feacbabf64500f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:30.379451 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-65f57669-e07d-45a3-baac-d0cf3703f2a2 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] 10.222.0.53 "GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2" status: 200 len: 1314 microversion: 2.1 time: 0.461059 Aug 27 04:31:30.382799 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 51/100] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:31:29 2021] GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2 => generated 1314 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:30.488864 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-33f5ed54-36a1-470f-bdd3-35f2b4fdac7e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:30.489973 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-33f5ed54-36a1-470f-bdd3-35f2b4fdac7e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:30.514730 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-33f5ed54-36a1-470f-bdd3-35f2b4fdac7e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:30.514730 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-33f5ed54-36a1-470f-bdd3-35f2b4fdac7e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:30.514730 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-33f5ed54-36a1-470f-bdd3-35f2b4fdac7e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:30.514730 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-33f5ed54-36a1-470f-bdd3-35f2b4fdac7e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:30.769918 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-33f5ed54-36a1-470f-bdd3-35f2b4fdac7e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:30.785977 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-33f5ed54-36a1-470f-bdd3-35f2b4fdac7e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:30.790101 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-33f5ed54-36a1-470f-bdd3-35f2b4fdac7e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:30.792029 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-33f5ed54-36a1-470f-bdd3-35f2b4fdac7e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1406 microversion: 2.20 time: 0.308873 Aug 27 04:31:30.793863 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 50/101] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:31:30 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1406 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:31:31.152058 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-871c763f-7ab1-4b7a-9edd-6903990d7a72 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:31.153384 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-871c763f-7ab1-4b7a-9edd-6903990d7a72 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:31.165400 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-871c763f-7ab1-4b7a-9edd-6903990d7a72 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:31.165875 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-871c763f-7ab1-4b7a-9edd-6903990d7a72 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:31.167458 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-871c763f-7ab1-4b7a-9edd-6903990d7a72 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:31.168468 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-871c763f-7ab1-4b7a-9edd-6903990d7a72 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:31.322707 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-871c763f-7ab1-4b7a-9edd-6903990d7a72 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:31.330133 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-871c763f-7ab1-4b7a-9edd-6903990d7a72 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1363 microversion: 2.1 time: 0.186008 Aug 27 04:31:31.330723 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 52/102] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:31:31 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:31.399189 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-8a869045-b2ec-43b9-bd37-5063a0a91d5b tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:31.400842 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-8a869045-b2ec-43b9-bd37-5063a0a91d5b tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] [instance: a71f46a9-4083-4f82-99fe-e020c5d173c2] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:31.409187 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-8a869045-b2ec-43b9-bd37-5063a0a91d5b tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:31.410191 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-8a869045-b2ec-43b9-bd37-5063a0a91d5b tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:31.411474 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-8a869045-b2ec-43b9-bd37-5063a0a91d5b tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:31.412148 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-8a869045-b2ec-43b9-bd37-5063a0a91d5b tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:31.634666 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-8a869045-b2ec-43b9-bd37-5063a0a91d5b tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e934818a1e974ea1986b07a7d3e78cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90959ac150c48beb4feacbabf64500f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:31.647374 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-8a869045-b2ec-43b9-bd37-5063a0a91d5b tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] 10.222.0.53 "GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2" status: 200 len: 1314 microversion: 2.1 time: 0.252101 Aug 27 04:31:31.651596 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 51/103] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:31:31 2021] GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:31.817735 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-58ce8a16-682e-4cab-8966-d0d95a6a7ed5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:31.818630 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-58ce8a16-682e-4cab-8966-d0d95a6a7ed5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:31.829655 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-58ce8a16-682e-4cab-8966-d0d95a6a7ed5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:31.830552 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-58ce8a16-682e-4cab-8966-d0d95a6a7ed5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:31.830880 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-58ce8a16-682e-4cab-8966-d0d95a6a7ed5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:31.831311 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-58ce8a16-682e-4cab-8966-d0d95a6a7ed5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:31.977060 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-58ce8a16-682e-4cab-8966-d0d95a6a7ed5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:31.988002 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-58ce8a16-682e-4cab-8966-d0d95a6a7ed5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:31.990739 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-58ce8a16-682e-4cab-8966-d0d95a6a7ed5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:31.992234 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-58ce8a16-682e-4cab-8966-d0d95a6a7ed5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1406 microversion: 2.20 time: 0.184615 Aug 27 04:31:32.004457 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 53/104] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:31:31 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1406 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:31:32.346508 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-2038a49f-8bd8-491d-8827-46f1788d26c3 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:32.347135 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-2038a49f-8bd8-491d-8827-46f1788d26c3 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:32.357532 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2038a49f-8bd8-491d-8827-46f1788d26c3 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:32.357993 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2038a49f-8bd8-491d-8827-46f1788d26c3 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:32.360843 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2038a49f-8bd8-491d-8827-46f1788d26c3 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:32.361303 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2038a49f-8bd8-491d-8827-46f1788d26c3 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:32.566131 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-2038a49f-8bd8-491d-8827-46f1788d26c3 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:32.578631 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-2038a49f-8bd8-491d-8827-46f1788d26c3 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1363 microversion: 2.1 time: 0.235718 Aug 27 04:31:32.590142 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 52/105] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:31:32 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1363 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:32.671633 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-cc717ee3-e553-45e3-9dd0-0ae0861b33fa tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:32.672863 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-cc717ee3-e553-45e3-9dd0-0ae0861b33fa tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] [instance: a71f46a9-4083-4f82-99fe-e020c5d173c2] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:32.680620 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cc717ee3-e553-45e3-9dd0-0ae0861b33fa tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:32.681302 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cc717ee3-e553-45e3-9dd0-0ae0861b33fa tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:32.682267 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cc717ee3-e553-45e3-9dd0-0ae0861b33fa tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:32.682974 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cc717ee3-e553-45e3-9dd0-0ae0861b33fa tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:32.913489 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-cc717ee3-e553-45e3-9dd0-0ae0861b33fa tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e934818a1e974ea1986b07a7d3e78cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90959ac150c48beb4feacbabf64500f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:32.926395 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-cc717ee3-e553-45e3-9dd0-0ae0861b33fa tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] 10.222.0.53 "GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2" status: 200 len: 1314 microversion: 2.1 time: 0.256720 Aug 27 04:31:32.940825 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 54/106] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:31:32 2021] GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2 => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:33.011783 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-ae32d38e-8187-48f4-af8d-1af449ce8901 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:33.012487 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-ae32d38e-8187-48f4-af8d-1af449ce8901 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:33.021020 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ae32d38e-8187-48f4-af8d-1af449ce8901 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:33.021465 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ae32d38e-8187-48f4-af8d-1af449ce8901 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:33.022244 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ae32d38e-8187-48f4-af8d-1af449ce8901 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:33.031360 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ae32d38e-8187-48f4-af8d-1af449ce8901 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:33.328011 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-ae32d38e-8187-48f4-af8d-1af449ce8901 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:33.337020 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-ae32d38e-8187-48f4-af8d-1af449ce8901 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:33.338846 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-ae32d38e-8187-48f4-af8d-1af449ce8901 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:33.340245 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-ae32d38e-8187-48f4-af8d-1af449ce8901 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1406 microversion: 2.20 time: 0.332748 Aug 27 04:31:33.340990 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 53/107] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:31:33 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1406 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:31:33.602203 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-98ec181f-74bb-46a7-9cb8-5f10db6562ff tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:33.604351 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-98ec181f-74bb-46a7-9cb8-5f10db6562ff tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:33.614176 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-98ec181f-74bb-46a7-9cb8-5f10db6562ff tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:33.614836 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-98ec181f-74bb-46a7-9cb8-5f10db6562ff tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:33.616408 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-98ec181f-74bb-46a7-9cb8-5f10db6562ff tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:33.617335 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-98ec181f-74bb-46a7-9cb8-5f10db6562ff tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:33.782205 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-98ec181f-74bb-46a7-9cb8-5f10db6562ff tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:33.791384 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-98ec181f-74bb-46a7-9cb8-5f10db6562ff tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1363 microversion: 2.1 time: 0.197213 Aug 27 04:31:33.792004 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 55/108] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:31:33 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1363 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:31:33.958329 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-63688c3f-a99a-482f-aee7-6739f07d1886 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:33.958933 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-63688c3f-a99a-482f-aee7-6739f07d1886 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] [instance: a71f46a9-4083-4f82-99fe-e020c5d173c2] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:33.967707 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-63688c3f-a99a-482f-aee7-6739f07d1886 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:33.968258 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-63688c3f-a99a-482f-aee7-6739f07d1886 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:33.968988 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-63688c3f-a99a-482f-aee7-6739f07d1886 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:33.969794 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-63688c3f-a99a-482f-aee7-6739f07d1886 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:34.117730 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-63688c3f-a99a-482f-aee7-6739f07d1886 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e934818a1e974ea1986b07a7d3e78cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90959ac150c48beb4feacbabf64500f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:34.132774 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-63688c3f-a99a-482f-aee7-6739f07d1886 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] 10.222.0.53 "GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2" status: 200 len: 1314 microversion: 2.1 time: 0.179516 Aug 27 04:31:34.133384 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 54/109] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:31:33 2021] GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:34.373628 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-dfa9a09d-fb5d-4fb6-b3dc-e7968614d368 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:34.374492 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-dfa9a09d-fb5d-4fb6-b3dc-e7968614d368 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:34.380845 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-dfa9a09d-fb5d-4fb6-b3dc-e7968614d368 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:34.381292 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-dfa9a09d-fb5d-4fb6-b3dc-e7968614d368 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:34.382081 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-dfa9a09d-fb5d-4fb6-b3dc-e7968614d368 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:34.382646 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-dfa9a09d-fb5d-4fb6-b3dc-e7968614d368 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:34.578878 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-dfa9a09d-fb5d-4fb6-b3dc-e7968614d368 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:34.590023 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-dfa9a09d-fb5d-4fb6-b3dc-e7968614d368 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:34.593245 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-dfa9a09d-fb5d-4fb6-b3dc-e7968614d368 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:34.594855 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-dfa9a09d-fb5d-4fb6-b3dc-e7968614d368 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1406 microversion: 2.20 time: 0.225418 Aug 27 04:31:34.597018 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 56/110] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:31:34 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1406 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:31:34.818483 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-a9b79e76-34e6-40da-9a97-0bcd1ef32690 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:34.819319 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-a9b79e76-34e6-40da-9a97-0bcd1ef32690 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:34.826967 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a9b79e76-34e6-40da-9a97-0bcd1ef32690 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:34.827765 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a9b79e76-34e6-40da-9a97-0bcd1ef32690 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:34.828805 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a9b79e76-34e6-40da-9a97-0bcd1ef32690 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:34.829582 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a9b79e76-34e6-40da-9a97-0bcd1ef32690 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:35.009644 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-a9b79e76-34e6-40da-9a97-0bcd1ef32690 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:35.018992 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-a9b79e76-34e6-40da-9a97-0bcd1ef32690 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1363 microversion: 2.1 time: 0.204992 Aug 27 04:31:35.020022 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 55/111] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:31:34 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1363 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:35.152874 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-72db1c42-46fe-4d8e-882f-ae92778a6878 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:35.153778 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-72db1c42-46fe-4d8e-882f-ae92778a6878 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] [instance: a71f46a9-4083-4f82-99fe-e020c5d173c2] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:35.163617 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-72db1c42-46fe-4d8e-882f-ae92778a6878 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:35.164206 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-72db1c42-46fe-4d8e-882f-ae92778a6878 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:35.165599 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-72db1c42-46fe-4d8e-882f-ae92778a6878 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:35.166040 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-72db1c42-46fe-4d8e-882f-ae92778a6878 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:35.424784 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-72db1c42-46fe-4d8e-882f-ae92778a6878 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e934818a1e974ea1986b07a7d3e78cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90959ac150c48beb4feacbabf64500f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:35.432679 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-72db1c42-46fe-4d8e-882f-ae92778a6878 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] 10.222.0.53 "GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2" status: 200 len: 1314 microversion: 2.1 time: 0.285373 Aug 27 04:31:35.438203 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 56/112] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:31:35 2021] GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2 => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:35.536037 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [req-6f0d36ee-fe6f-4b39-a284-55724335ce75 req-a09382f3-52bf-4613-94ae-5e0b6064e99b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5598e9e1-bc44-4831-be1a-f478deba899b", "name": "network-vif-plugged", "status": "completed", "tag": "f8a58c4d-0881-4c48-9ebe-4070da2b40d9"}]} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:35.537843 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:31:35.537843 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: warnings.warn(msg) Aug 27 04:31:35.553929 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-6f0d36ee-fe6f-4b39-a284-55724335ce75 req-a09382f3-52bf-4613-94ae-5e0b6064e99b service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:35.554741 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-6f0d36ee-fe6f-4b39-a284-55724335ce75 req-a09382f3-52bf-4613-94ae-5e0b6064e99b service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:35.583418 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.compute.server_external_events [req-6f0d36ee-fe6f-4b39-a284-55724335ce75 req-a09382f3-52bf-4613-94ae-5e0b6064e99b service nova] Creating event network-vif-plugged:f8a58c4d-0881-4c48-9ebe-4070da2b40d9 for instance 5598e9e1-bc44-4831-be1a-f478deba899b on hv-cinder-80403 Aug 27 04:31:35.590836 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [req-6f0d36ee-fe6f-4b39-a284-55724335ce75 req-a09382f3-52bf-4613-94ae-5e0b6064e99b service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.509335 Aug 27 04:31:35.592443 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 57/113] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:31:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:31:35.614542 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-0102e167-93a4-4767-a00b-5dda31df74ba tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:35.615622 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-0102e167-93a4-4767-a00b-5dda31df74ba tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:35.633706 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0102e167-93a4-4767-a00b-5dda31df74ba tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:35.636362 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0102e167-93a4-4767-a00b-5dda31df74ba tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:35.639249 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0102e167-93a4-4767-a00b-5dda31df74ba tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:35.641379 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0102e167-93a4-4767-a00b-5dda31df74ba tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:35.837262 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-0102e167-93a4-4767-a00b-5dda31df74ba tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:35.864890 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-0102e167-93a4-4767-a00b-5dda31df74ba tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:35.869471 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-0102e167-93a4-4767-a00b-5dda31df74ba tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:35.872161 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-0102e167-93a4-4767-a00b-5dda31df74ba tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1406 microversion: 2.20 time: 0.261753 Aug 27 04:31:35.874940 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 57/114] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:31:35 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1406 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:31:36.037969 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-de62d9e2-fdf1-4dba-ba81-8a64a18d5a76 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:36.040591 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-de62d9e2-fdf1-4dba-ba81-8a64a18d5a76 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:36.051924 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-de62d9e2-fdf1-4dba-ba81-8a64a18d5a76 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:36.054150 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-de62d9e2-fdf1-4dba-ba81-8a64a18d5a76 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:36.055779 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-de62d9e2-fdf1-4dba-ba81-8a64a18d5a76 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:36.058108 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-de62d9e2-fdf1-4dba-ba81-8a64a18d5a76 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:36.316049 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-de62d9e2-fdf1-4dba-ba81-8a64a18d5a76 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:36.325547 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-de62d9e2-fdf1-4dba-ba81-8a64a18d5a76 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1363 microversion: 2.1 time: 0.291365 Aug 27 04:31:36.326213 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 58/115] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:31:36 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1363 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:36.454667 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-a0910601-0796-4849-aed3-cdf7597ae599 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:36.455521 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-a0910601-0796-4849-aed3-cdf7597ae599 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] [instance: a71f46a9-4083-4f82-99fe-e020c5d173c2] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:36.465189 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a0910601-0796-4849-aed3-cdf7597ae599 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:36.465189 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a0910601-0796-4849-aed3-cdf7597ae599 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:36.465189 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a0910601-0796-4849-aed3-cdf7597ae599 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:36.465189 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a0910601-0796-4849-aed3-cdf7597ae599 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:36.598956 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-a0910601-0796-4849-aed3-cdf7597ae599 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e934818a1e974ea1986b07a7d3e78cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90959ac150c48beb4feacbabf64500f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:36.610363 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-a0910601-0796-4849-aed3-cdf7597ae599 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] 10.222.0.53 "GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2" status: 200 len: 1314 microversion: 2.1 time: 0.158735 Aug 27 04:31:36.614509 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 58/116] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:31:36 2021] GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:36.890739 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-7da873ed-3766-4ab5-8db5-d6e0dd8ca7d0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:36.891568 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-7da873ed-3766-4ab5-8db5-d6e0dd8ca7d0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:36.898170 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7da873ed-3766-4ab5-8db5-d6e0dd8ca7d0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:36.899231 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7da873ed-3766-4ab5-8db5-d6e0dd8ca7d0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:36.900115 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7da873ed-3766-4ab5-8db5-d6e0dd8ca7d0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:36.900607 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7da873ed-3766-4ab5-8db5-d6e0dd8ca7d0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:37.039260 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-7da873ed-3766-4ab5-8db5-d6e0dd8ca7d0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:37.047341 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-7da873ed-3766-4ab5-8db5-d6e0dd8ca7d0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:37.048942 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-7da873ed-3766-4ab5-8db5-d6e0dd8ca7d0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:37.050151 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-7da873ed-3766-4ab5-8db5-d6e0dd8ca7d0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1406 microversion: 2.20 time: 0.163217 Aug 27 04:31:37.050868 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 59/117] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:31:36 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:31:37.342955 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-48ae9fb3-3b2d-49b4-a58a-c612f0d81ab3 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:37.343617 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-48ae9fb3-3b2d-49b4-a58a-c612f0d81ab3 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:37.350029 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-48ae9fb3-3b2d-49b4-a58a-c612f0d81ab3 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:37.350471 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-48ae9fb3-3b2d-49b4-a58a-c612f0d81ab3 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:37.351246 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-48ae9fb3-3b2d-49b4-a58a-c612f0d81ab3 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:37.352168 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-48ae9fb3-3b2d-49b4-a58a-c612f0d81ab3 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:37.493068 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-48ae9fb3-3b2d-49b4-a58a-c612f0d81ab3 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:37.500984 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-48ae9fb3-3b2d-49b4-a58a-c612f0d81ab3 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1363 microversion: 2.1 time: 0.161608 Aug 27 04:31:37.501956 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 59/118] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:31:37 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:37.626766 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [req-66ece3db-1fcc-40a2-9240-5c6eb650ecfc req-ebc84695-539a-4df4-85de-a35040367bff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a71f46a9-4083-4f82-99fe-e020c5d173c2", "name": "network-vif-plugged", "status": "completed", "tag": "901b4a6c-2cea-4fb7-b496-26f960e19750"}, {"server_uuid": "b3173859-725e-4d66-80af-4223a6643935", "name": "network-vif-plugged", "status": "completed", "tag": "698af269-46a5-4892-822b-9ef4aa21fa2e"}]} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:37.628271 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-5e6f34e2-3185-455b-a3b2-f0253677d8b0 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:37.628782 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:31:37.628782 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: warnings.warn(msg) Aug 27 04:31:37.638215 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-5e6f34e2-3185-455b-a3b2-f0253677d8b0 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] [instance: a71f46a9-4083-4f82-99fe-e020c5d173c2] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:37.638345 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-66ece3db-1fcc-40a2-9240-5c6eb650ecfc req-ebc84695-539a-4df4-85de-a35040367bff service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:37.638721 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-66ece3db-1fcc-40a2-9240-5c6eb650ecfc req-ebc84695-539a-4df4-85de-a35040367bff service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:37.644941 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5e6f34e2-3185-455b-a3b2-f0253677d8b0 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:37.645394 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5e6f34e2-3185-455b-a3b2-f0253677d8b0 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:37.646173 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5e6f34e2-3185-455b-a3b2-f0253677d8b0 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:37.646610 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5e6f34e2-3185-455b-a3b2-f0253677d8b0 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:37.652491 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.compute.server_external_events [req-66ece3db-1fcc-40a2-9240-5c6eb650ecfc req-ebc84695-539a-4df4-85de-a35040367bff service nova] Creating event network-vif-plugged:901b4a6c-2cea-4fb7-b496-26f960e19750 for instance a71f46a9-4083-4f82-99fe-e020c5d173c2 on hv-cinder-80403 Aug 27 04:31:37.652997 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.compute.server_external_events [req-66ece3db-1fcc-40a2-9240-5c6eb650ecfc req-ebc84695-539a-4df4-85de-a35040367bff service nova] Creating event network-vif-plugged:698af269-46a5-4892-822b-9ef4aa21fa2e for instance b3173859-725e-4d66-80af-4223a6643935 on hv-cinder-80403 Aug 27 04:31:37.659381 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [req-66ece3db-1fcc-40a2-9240-5c6eb650ecfc req-ebc84695-539a-4df4-85de-a35040367bff service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036596 Aug 27 04:31:37.660249 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 60/119] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:31:37 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:31:37.832926 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-5e6f34e2-3185-455b-a3b2-f0253677d8b0 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e934818a1e974ea1986b07a7d3e78cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90959ac150c48beb4feacbabf64500f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:37.842342 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-5e6f34e2-3185-455b-a3b2-f0253677d8b0 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] 10.222.0.53 "GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2" status: 200 len: 1314 microversion: 2.1 time: 0.217500 Aug 27 04:31:37.849998 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 60/120] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:31:37 2021] GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:31:38.073077 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-af94ad59-3153-43a6-9505-d62d09a4bb38 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:38.074472 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-af94ad59-3153-43a6-9505-d62d09a4bb38 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:38.082226 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-af94ad59-3153-43a6-9505-d62d09a4bb38 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:38.083274 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-af94ad59-3153-43a6-9505-d62d09a4bb38 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:38.084494 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-af94ad59-3153-43a6-9505-d62d09a4bb38 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:38.085367 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-af94ad59-3153-43a6-9505-d62d09a4bb38 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:38.296783 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-af94ad59-3153-43a6-9505-d62d09a4bb38 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:38.312348 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-af94ad59-3153-43a6-9505-d62d09a4bb38 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:38.313929 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-af94ad59-3153-43a6-9505-d62d09a4bb38 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:38.315053 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-af94ad59-3153-43a6-9505-d62d09a4bb38 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1406 microversion: 2.20 time: 0.248249 Aug 27 04:31:38.328143 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 61/121] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:31:38 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1406 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:31:38.518476 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-4de3a347-d6cf-4c0a-9793-41ba0b09c5ff tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:38.519083 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-4de3a347-d6cf-4c0a-9793-41ba0b09c5ff tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:38.525163 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4de3a347-d6cf-4c0a-9793-41ba0b09c5ff tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:38.525600 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4de3a347-d6cf-4c0a-9793-41ba0b09c5ff tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:38.526370 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4de3a347-d6cf-4c0a-9793-41ba0b09c5ff tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:38.526798 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4de3a347-d6cf-4c0a-9793-41ba0b09c5ff tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:38.653180 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-4de3a347-d6cf-4c0a-9793-41ba0b09c5ff tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:38.660679 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-4de3a347-d6cf-4c0a-9793-41ba0b09c5ff tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1363 microversion: 2.1 time: 0.145934 Aug 27 04:31:38.661249 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 61/122] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:31:38 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:38.866032 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-c65c3738-ae97-4740-9b03-0f8c747fe753 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:38.866765 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-c65c3738-ae97-4740-9b03-0f8c747fe753 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] [instance: a71f46a9-4083-4f82-99fe-e020c5d173c2] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:38.873947 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c65c3738-ae97-4740-9b03-0f8c747fe753 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:38.874422 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c65c3738-ae97-4740-9b03-0f8c747fe753 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:38.875277 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c65c3738-ae97-4740-9b03-0f8c747fe753 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:38.875732 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c65c3738-ae97-4740-9b03-0f8c747fe753 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:39.006989 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-c65c3738-ae97-4740-9b03-0f8c747fe753 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e934818a1e974ea1986b07a7d3e78cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90959ac150c48beb4feacbabf64500f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:39.022793 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-c65c3738-ae97-4740-9b03-0f8c747fe753 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] 10.222.0.53 "GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2" status: 200 len: 1314 microversion: 2.1 time: 0.152237 Aug 27 04:31:39.022793 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 62/123] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:31:38 2021] GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:39.335835 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-3fffb7a7-cec2-43f0-b972-61c1d6251a03 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:39.338673 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-3fffb7a7-cec2-43f0-b972-61c1d6251a03 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:39.345712 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3fffb7a7-cec2-43f0-b972-61c1d6251a03 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:39.346385 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3fffb7a7-cec2-43f0-b972-61c1d6251a03 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:39.347721 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3fffb7a7-cec2-43f0-b972-61c1d6251a03 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:39.348331 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3fffb7a7-cec2-43f0-b972-61c1d6251a03 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:39.527458 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-3fffb7a7-cec2-43f0-b972-61c1d6251a03 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:39.536126 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-3fffb7a7-cec2-43f0-b972-61c1d6251a03 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:39.537671 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-3fffb7a7-cec2-43f0-b972-61c1d6251a03 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:39.538948 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-3fffb7a7-cec2-43f0-b972-61c1d6251a03 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1406 microversion: 2.20 time: 0.207411 Aug 27 04:31:39.539548 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 62/124] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:31:39 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1406 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:31:39.678613 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-35d7b51d-d206-4431-a715-d7fa214f5797 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:39.679315 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-35d7b51d-d206-4431-a715-d7fa214f5797 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:39.691616 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-35d7b51d-d206-4431-a715-d7fa214f5797 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:39.692098 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-35d7b51d-d206-4431-a715-d7fa214f5797 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:39.693266 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-35d7b51d-d206-4431-a715-d7fa214f5797 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:39.693704 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-35d7b51d-d206-4431-a715-d7fa214f5797 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:39.826041 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-35d7b51d-d206-4431-a715-d7fa214f5797 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:39.833640 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-35d7b51d-d206-4431-a715-d7fa214f5797 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1549 microversion: 2.1 time: 0.159425 Aug 27 04:31:39.834281 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 63/125] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:31:39 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1549 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:39.851406 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-81964daa-d214-4cbe-bf6b-72727e1404d8 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:39.852417 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-81964daa-d214-4cbe-bf6b-72727e1404d8 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:39.858212 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-81964daa-d214-4cbe-bf6b-72727e1404d8 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:39.858663 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-81964daa-d214-4cbe-bf6b-72727e1404d8 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:39.859442 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-81964daa-d214-4cbe-bf6b-72727e1404d8 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:39.860086 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-81964daa-d214-4cbe-bf6b-72727e1404d8 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:39.998232 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-81964daa-d214-4cbe-bf6b-72727e1404d8 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.150458 Aug 27 04:31:39.998865 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 63/126] 10.222.0.53 () {58 vars in 1275 bytes} [Fri Aug 27 04:31:39 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/os-interface => generated 284 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:31:40.030952 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-a281d1bc-d03d-4431-9ac4-fb7970cb5413 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:40.031807 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-a281d1bc-d03d-4431-9ac4-fb7970cb5413 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] [instance: a71f46a9-4083-4f82-99fe-e020c5d173c2] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:40.041020 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a281d1bc-d03d-4431-9ac4-fb7970cb5413 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:40.041392 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a281d1bc-d03d-4431-9ac4-fb7970cb5413 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:40.042171 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a281d1bc-d03d-4431-9ac4-fb7970cb5413 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:40.042602 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a281d1bc-d03d-4431-9ac4-fb7970cb5413 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:40.181458 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-a281d1bc-d03d-4431-9ac4-fb7970cb5413 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e934818a1e974ea1986b07a7d3e78cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90959ac150c48beb4feacbabf64500f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:40.189855 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-a281d1bc-d03d-4431-9ac4-fb7970cb5413 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] 10.222.0.53 "GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2" status: 200 len: 1314 microversion: 2.1 time: 0.162658 Aug 27 04:31:40.190755 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 64/127] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:31:40 2021] GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:31:40.557861 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-28425512-3cba-4696-a0c8-beadd580a8a7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:40.558546 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-28425512-3cba-4696-a0c8-beadd580a8a7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:40.576641 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-28425512-3cba-4696-a0c8-beadd580a8a7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:40.590021 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-28425512-3cba-4696-a0c8-beadd580a8a7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:40.596550 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-28425512-3cba-4696-a0c8-beadd580a8a7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:40.598103 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-28425512-3cba-4696-a0c8-beadd580a8a7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:41.026765 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-28425512-3cba-4696-a0c8-beadd580a8a7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:41.042681 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-28425512-3cba-4696-a0c8-beadd580a8a7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:41.048387 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-28425512-3cba-4696-a0c8-beadd580a8a7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:41.051655 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-28425512-3cba-4696-a0c8-beadd580a8a7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1406 microversion: 2.20 time: 0.495861 Aug 27 04:31:41.053764 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 64/128] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:31:40 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1406 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:31:41.208144 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-963aa00f-b19f-499d-b73a-4bc689f71a76 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:41.209398 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-963aa00f-b19f-499d-b73a-4bc689f71a76 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] [instance: a71f46a9-4083-4f82-99fe-e020c5d173c2] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:41.218304 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-963aa00f-b19f-499d-b73a-4bc689f71a76 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:41.219256 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-963aa00f-b19f-499d-b73a-4bc689f71a76 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:41.220293 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-963aa00f-b19f-499d-b73a-4bc689f71a76 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:41.220924 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-963aa00f-b19f-499d-b73a-4bc689f71a76 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:41.424320 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-963aa00f-b19f-499d-b73a-4bc689f71a76 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e934818a1e974ea1986b07a7d3e78cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90959ac150c48beb4feacbabf64500f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:41.433001 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-963aa00f-b19f-499d-b73a-4bc689f71a76 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] 10.222.0.53 "GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2" status: 200 len: 1314 microversion: 2.1 time: 0.228350 Aug 27 04:31:41.442704 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 65/129] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:31:41 2021] GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:41.929182 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-b112727d-e5b4-4eae-a957-10e6b0b5088c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:41.930842 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-b112727d-e5b4-4eae-a957-10e6b0b5088c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:41.936917 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [req-6fd16e7a-d89b-42e2-b874-1c775e255379 req-ebc145a6-7947-41e1-adc5-0be1f9d49d14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5598e9e1-bc44-4831-be1a-f478deba899b", "tag": "f8a58c4d-0881-4c48-9ebe-4070da2b40d9"}]} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:41.937566 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b112727d-e5b4-4eae-a957-10e6b0b5088c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:41.938217 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b112727d-e5b4-4eae-a957-10e6b0b5088c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:41.939198 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b112727d-e5b4-4eae-a957-10e6b0b5088c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:41.939830 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b112727d-e5b4-4eae-a957-10e6b0b5088c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:41.940049 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:31:41.940049 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: warnings.warn(msg) Aug 27 04:31:41.951191 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-6fd16e7a-d89b-42e2-b874-1c775e255379 req-ebc145a6-7947-41e1-adc5-0be1f9d49d14 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:41.951637 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-6fd16e7a-d89b-42e2-b874-1c775e255379 req-ebc145a6-7947-41e1-adc5-0be1f9d49d14 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:41.975701 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.compute.server_external_events [req-6fd16e7a-d89b-42e2-b874-1c775e255379 req-ebc145a6-7947-41e1-adc5-0be1f9d49d14 service nova] Creating event network-changed:f8a58c4d-0881-4c48-9ebe-4070da2b40d9 for instance 5598e9e1-bc44-4831-be1a-f478deba899b on hv-cinder-80403 Aug 27 04:31:41.986413 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [req-6fd16e7a-d89b-42e2-b874-1c775e255379 req-ebc145a6-7947-41e1-adc5-0be1f9d49d14 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056827 Aug 27 04:31:41.987816 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 66/130] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:31:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:31:42.072652 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-2f9c8bf7-e626-435c-ac9d-c28334dfd2f2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:42.073677 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-2f9c8bf7-e626-435c-ac9d-c28334dfd2f2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:42.081454 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-2f9c8bf7-e626-435c-ac9d-c28334dfd2f2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:42.082161 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-2f9c8bf7-e626-435c-ac9d-c28334dfd2f2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:42.083519 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-2f9c8bf7-e626-435c-ac9d-c28334dfd2f2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:42.083969 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-2f9c8bf7-e626-435c-ac9d-c28334dfd2f2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:42.263512 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-2f9c8bf7-e626-435c-ac9d-c28334dfd2f2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:42.272604 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-2f9c8bf7-e626-435c-ac9d-c28334dfd2f2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:42.286909 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-2f9c8bf7-e626-435c-ac9d-c28334dfd2f2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:42.288132 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-2f9c8bf7-e626-435c-ac9d-c28334dfd2f2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1599 microversion: 2.20 time: 0.221442 Aug 27 04:31:42.289048 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 67/131] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:31:42 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1599 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:31:42.310783 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-91097a2f-ad10-46c3-ba6a-5a378cbb5452 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:42.311567 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-91097a2f-ad10-46c3-ba6a-5a378cbb5452 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:42.318572 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-91097a2f-ad10-46c3-ba6a-5a378cbb5452 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:42.319602 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-91097a2f-ad10-46c3-ba6a-5a378cbb5452 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:42.321379 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-91097a2f-ad10-46c3-ba6a-5a378cbb5452 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:42.322164 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-91097a2f-ad10-46c3-ba6a-5a378cbb5452 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:42.463418 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-91097a2f-ad10-46c3-ba6a-5a378cbb5452 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.159615 Aug 27 04:31:42.464061 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 68/132] 10.222.0.53 () {60 vars in 1316 bytes} [Fri Aug 27 04:31:42 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/os-interface => generated 285 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:31:42.469406 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-923a80e4-53ed-4826-a301-ff1319ac39eb tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:42.470572 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-923a80e4-53ed-4826-a301-ff1319ac39eb tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] [instance: a71f46a9-4083-4f82-99fe-e020c5d173c2] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:42.478197 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-923a80e4-53ed-4826-a301-ff1319ac39eb tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:42.479882 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-923a80e4-53ed-4826-a301-ff1319ac39eb tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:42.480798 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-923a80e4-53ed-4826-a301-ff1319ac39eb tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:42.481978 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-923a80e4-53ed-4826-a301-ff1319ac39eb tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:42.649749 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-923a80e4-53ed-4826-a301-ff1319ac39eb tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e934818a1e974ea1986b07a7d3e78cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90959ac150c48beb4feacbabf64500f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:42.660349 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-923a80e4-53ed-4826-a301-ff1319ac39eb tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] 10.222.0.53 "GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2" status: 200 len: 1314 microversion: 2.1 time: 0.194581 Aug 27 04:31:42.662417 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 69/133] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:31:42 2021] GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:43.683608 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-a8a368a5-94de-46d6-b926-80f774e93ea7 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:43.684561 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-a8a368a5-94de-46d6-b926-80f774e93ea7 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] [instance: a71f46a9-4083-4f82-99fe-e020c5d173c2] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:43.692097 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a8a368a5-94de-46d6-b926-80f774e93ea7 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:43.692892 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a8a368a5-94de-46d6-b926-80f774e93ea7 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:43.693790 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a8a368a5-94de-46d6-b926-80f774e93ea7 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:43.694296 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a8a368a5-94de-46d6-b926-80f774e93ea7 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:43.833598 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-a8a368a5-94de-46d6-b926-80f774e93ea7 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e934818a1e974ea1986b07a7d3e78cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90959ac150c48beb4feacbabf64500f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:43.843008 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-a8a368a5-94de-46d6-b926-80f774e93ea7 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] 10.222.0.53 "GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2" status: 200 len: 1314 microversion: 2.1 time: 0.164922 Aug 27 04:31:43.844557 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 70/134] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:31:43 2021] GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:43.986603 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-868b4138-6a2c-4c24-a31d-055afed7ae6f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:43.987514 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-868b4138-6a2c-4c24-a31d-055afed7ae6f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:44.004673 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-868b4138-6a2c-4c24-a31d-055afed7ae6f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:44.005398 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-868b4138-6a2c-4c24-a31d-055afed7ae6f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:44.006726 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-868b4138-6a2c-4c24-a31d-055afed7ae6f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:44.007382 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-868b4138-6a2c-4c24-a31d-055afed7ae6f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:45.065241 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-868b4138-6a2c-4c24-a31d-055afed7ae6f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 14 microversion: 2.20 time: 1.083038 Aug 27 04:31:45.068600 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 71/135] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:31:43 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 14 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:45.071679 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [req-4cb41764-4c74-4cfc-8149-d0dce54f2bb9 req-59a3f999-7bf8-4595-9604-d72f5cce0ad6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3173859-725e-4d66-80af-4223a6643935", "tag": "698af269-46a5-4892-822b-9ef4aa21fa2e"}]} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:45.075098 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:31:45.075098 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: warnings.warn(msg) Aug 27 04:31:45.100419 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-4cb41764-4c74-4cfc-8149-d0dce54f2bb9 req-59a3f999-7bf8-4595-9604-d72f5cce0ad6 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:45.107309 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-b112727d-e5b4-4eae-a957-10e6b0b5088c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 14 microversion: 2.1 time: 3.182088 Aug 27 04:31:45.107935 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 65/136] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:31:41 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 14 bytes in 3184 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:31:45.108536 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-4cb41764-4c74-4cfc-8149-d0dce54f2bb9 req-59a3f999-7bf8-4595-9604-d72f5cce0ad6 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:45.114561 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-1dd246e1-a4ec-413f-895a-eb20745d96ef tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:45.115305 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-1dd246e1-a4ec-413f-895a-eb20745d96ef tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] [instance: a71f46a9-4083-4f82-99fe-e020c5d173c2] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:45.127567 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1dd246e1-a4ec-413f-895a-eb20745d96ef tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:45.127852 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1dd246e1-a4ec-413f-895a-eb20745d96ef tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:45.128682 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1dd246e1-a4ec-413f-895a-eb20745d96ef tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:45.129124 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1dd246e1-a4ec-413f-895a-eb20745d96ef tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:45.171936 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.compute.server_external_events [req-4cb41764-4c74-4cfc-8149-d0dce54f2bb9 req-59a3f999-7bf8-4595-9604-d72f5cce0ad6 service nova] Creating event network-changed:698af269-46a5-4892-822b-9ef4aa21fa2e for instance b3173859-725e-4d66-80af-4223a6643935 on hv-cinder-80403 Aug 27 04:31:45.191835 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [req-4cb41764-4c74-4cfc-8149-d0dce54f2bb9 req-59a3f999-7bf8-4595-9604-d72f5cce0ad6 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120231 Aug 27 04:31:45.197918 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 72/137] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:31:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:31:45.376095 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-1dd246e1-a4ec-413f-895a-eb20745d96ef tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e934818a1e974ea1986b07a7d3e78cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90959ac150c48beb4feacbabf64500f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:45.394718 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-1dd246e1-a4ec-413f-895a-eb20745d96ef tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] 10.222.0.53 "GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2" status: 200 len: 1314 microversion: 2.1 time: 0.285154 Aug 27 04:31:45.396283 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 66/138] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:31:45 2021] GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2 => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:46.077108 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-246cf726-e508-4eea-9fb8-14c710cf9111 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:46.078229 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-246cf726-e508-4eea-9fb8-14c710cf9111 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:46.084606 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-246cf726-e508-4eea-9fb8-14c710cf9111 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:46.085037 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-246cf726-e508-4eea-9fb8-14c710cf9111 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:46.086342 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-246cf726-e508-4eea-9fb8-14c710cf9111 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:46.086994 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-246cf726-e508-4eea-9fb8-14c710cf9111 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:46.119132 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-b1dc130b-0273-41b0-8dcc-819c950fb269 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:46.120419 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-b1dc130b-0273-41b0-8dcc-819c950fb269 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:46.133362 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b1dc130b-0273-41b0-8dcc-819c950fb269 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:46.133992 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b1dc130b-0273-41b0-8dcc-819c950fb269 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:46.135028 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b1dc130b-0273-41b0-8dcc-819c950fb269 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:46.135653 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b1dc130b-0273-41b0-8dcc-819c950fb269 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:46.275865 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-246cf726-e508-4eea-9fb8-14c710cf9111 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 14 microversion: 2.20 time: 0.203128 Aug 27 04:31:46.279113 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 73/139] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:31:46 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 14 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:46.318036 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-b1dc130b-0273-41b0-8dcc-819c950fb269 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 14 microversion: 2.1 time: 0.202661 Aug 27 04:31:46.321794 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 67/140] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:31:46 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 14 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 04:31:46.413939 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-8b0ddf08-5d55-43a8-a66a-a7dd52603b90 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:31:46.414637 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-8b0ddf08-5d55-43a8-a66a-a7dd52603b90 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] [instance: a71f46a9-4083-4f82-99fe-e020c5d173c2] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:46.421090 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8b0ddf08-5d55-43a8-a66a-a7dd52603b90 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:46.421539 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8b0ddf08-5d55-43a8-a66a-a7dd52603b90 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:46.422305 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8b0ddf08-5d55-43a8-a66a-a7dd52603b90 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:46.422742 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8b0ddf08-5d55-43a8-a66a-a7dd52603b90 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:46.591185 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-8b0ddf08-5d55-43a8-a66a-a7dd52603b90 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e934818a1e974ea1986b07a7d3e78cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90959ac150c48beb4feacbabf64500f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:31:46.607415 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-8b0ddf08-5d55-43a8-a66a-a7dd52603b90 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] 10.222.0.53 "GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2" status: 200 len: 1501 microversion: 2.1 time: 0.197137 Aug 27 04:31:46.608861 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 74/141] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:31:46 2021] GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2 => generated 1501 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:47.286898 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-6bb7e52b-25b9-43be-a7ab-50273531d7f0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:47.288202 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-6bb7e52b-25b9-43be-a7ab-50273531d7f0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:47.295289 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6bb7e52b-25b9-43be-a7ab-50273531d7f0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:47.295652 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6bb7e52b-25b9-43be-a7ab-50273531d7f0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:47.296450 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6bb7e52b-25b9-43be-a7ab-50273531d7f0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:47.296886 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6bb7e52b-25b9-43be-a7ab-50273531d7f0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:47.329563 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-5029ade6-c336-4284-8845-aec4c9c57a93 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:47.330450 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-5029ade6-c336-4284-8845-aec4c9c57a93 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:47.337164 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5029ade6-c336-4284-8845-aec4c9c57a93 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:47.337815 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5029ade6-c336-4284-8845-aec4c9c57a93 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:47.339055 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5029ade6-c336-4284-8845-aec4c9c57a93 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:47.339334 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5029ade6-c336-4284-8845-aec4c9c57a93 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:47.475350 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-6bb7e52b-25b9-43be-a7ab-50273531d7f0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 14 microversion: 2.20 time: 0.192260 Aug 27 04:31:47.476165 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 68/142] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:31:47 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 14 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:47.519151 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-5029ade6-c336-4284-8845-aec4c9c57a93 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 14 microversion: 2.1 time: 0.193058 Aug 27 04:31:47.520010 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 75/143] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:31:47 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 14 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 04:31:48.487601 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-9e8c62e0-cb32-48d6-80e0-4f3d8a32bc05 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:48.488774 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-9e8c62e0-cb32-48d6-80e0-4f3d8a32bc05 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:48.498651 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9e8c62e0-cb32-48d6-80e0-4f3d8a32bc05 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:48.499096 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9e8c62e0-cb32-48d6-80e0-4f3d8a32bc05 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:48.499876 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9e8c62e0-cb32-48d6-80e0-4f3d8a32bc05 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:48.500334 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9e8c62e0-cb32-48d6-80e0-4f3d8a32bc05 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:48.531405 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-5b732c5c-bd9f-4a52-9e69-16c45c736eb6 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:48.533050 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-5b732c5c-bd9f-4a52-9e69-16c45c736eb6 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:48.540949 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5b732c5c-bd9f-4a52-9e69-16c45c736eb6 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:48.541503 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5b732c5c-bd9f-4a52-9e69-16c45c736eb6 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:48.542445 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5b732c5c-bd9f-4a52-9e69-16c45c736eb6 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:48.543126 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5b732c5c-bd9f-4a52-9e69-16c45c736eb6 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:48.646725 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-9e8c62e0-cb32-48d6-80e0-4f3d8a32bc05 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 14 microversion: 2.20 time: 0.163405 Aug 27 04:31:48.650728 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 69/144] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:31:48 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 14 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:48.688046 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-5b732c5c-bd9f-4a52-9e69-16c45c736eb6 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 14 microversion: 2.1 time: 0.161442 Aug 27 04:31:48.689777 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 76/145] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:31:48 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 14 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 04:31:49.658451 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-36d1b6a6-74e8-4122-a2d6-1a10e7c30fa5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:49.659473 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-36d1b6a6-74e8-4122-a2d6-1a10e7c30fa5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:49.666389 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-36d1b6a6-74e8-4122-a2d6-1a10e7c30fa5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:49.666865 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-36d1b6a6-74e8-4122-a2d6-1a10e7c30fa5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:49.667677 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-36d1b6a6-74e8-4122-a2d6-1a10e7c30fa5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:49.668055 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-36d1b6a6-74e8-4122-a2d6-1a10e7c30fa5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:49.699435 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-f27db573-0883-41f6-80fb-8e5f6d45b4c3 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:49.700468 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-f27db573-0883-41f6-80fb-8e5f6d45b4c3 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:49.708674 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f27db573-0883-41f6-80fb-8e5f6d45b4c3 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:49.709129 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f27db573-0883-41f6-80fb-8e5f6d45b4c3 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:49.709903 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f27db573-0883-41f6-80fb-8e5f6d45b4c3 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:49.710336 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f27db573-0883-41f6-80fb-8e5f6d45b4c3 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:49.824881 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-36d1b6a6-74e8-4122-a2d6-1a10e7c30fa5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 14 microversion: 2.20 time: 0.170202 Aug 27 04:31:49.828148 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 70/146] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:31:49 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 14 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:49.865127 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-f27db573-0883-41f6-80fb-8e5f6d45b4c3 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 14 microversion: 2.1 time: 0.169684 Aug 27 04:31:49.869119 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 77/147] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:31:49 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 14 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 04:31:50.187070 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-7485c782-730e-478e-ac74-b8b1a2c41740 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "37032f7c-b540-4b93-8b84-43dcab0618f3"}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:50.203734 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-7485c782-730e-478e-ac74-b8b1a2c41740 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] [instance: a71f46a9-4083-4f82-99fe-e020c5d173c2] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:50.212154 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7485c782-730e-478e-ac74-b8b1a2c41740 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:50.222979 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7485c782-730e-478e-ac74-b8b1a2c41740 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:50.224180 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7485c782-730e-478e-ac74-b8b1a2c41740 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:50.224642 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7485c782-730e-478e-ac74-b8b1a2c41740 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:50.543862 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-7485c782-730e-478e-ac74-b8b1a2c41740 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] 10.222.0.53 "POST /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.363717 Aug 27 04:31:50.544636 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 71/148] 10.222.0.53 () {60 vars in 1323 bytes} [Fri Aug 27 04:31:50 2021] POST /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2/os-volume_attachments => generated 194 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:31:50.835229 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-333817a1-9bdd-4bec-9f90-d883301a9ac9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:50.836452 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-333817a1-9bdd-4bec-9f90-d883301a9ac9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:50.843089 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-333817a1-9bdd-4bec-9f90-d883301a9ac9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:50.843551 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-333817a1-9bdd-4bec-9f90-d883301a9ac9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:50.844355 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-333817a1-9bdd-4bec-9f90-d883301a9ac9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:50.844788 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-333817a1-9bdd-4bec-9f90-d883301a9ac9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:50.882410 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-b9f9b740-a6f5-4e2c-8ecd-f94261e29262 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:50.883528 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-b9f9b740-a6f5-4e2c-8ecd-f94261e29262 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:50.893675 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b9f9b740-a6f5-4e2c-8ecd-f94261e29262 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:50.894269 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b9f9b740-a6f5-4e2c-8ecd-f94261e29262 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:50.895410 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b9f9b740-a6f5-4e2c-8ecd-f94261e29262 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:50.895755 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b9f9b740-a6f5-4e2c-8ecd-f94261e29262 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:51.012930 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-333817a1-9bdd-4bec-9f90-d883301a9ac9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 14 microversion: 2.20 time: 0.181251 Aug 27 04:31:51.014391 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 78/149] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:31:50 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 14 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:51.056766 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-b9f9b740-a6f5-4e2c-8ecd-f94261e29262 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 14 microversion: 2.1 time: 0.182463 Aug 27 04:31:51.058055 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 72/150] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:31:50 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 14 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:31:52.025819 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-cf492d62-38ab-4a1f-b9f5-a51a7985d848 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:52.026957 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-cf492d62-38ab-4a1f-b9f5-a51a7985d848 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:52.035392 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cf492d62-38ab-4a1f-b9f5-a51a7985d848 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:52.036150 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cf492d62-38ab-4a1f-b9f5-a51a7985d848 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:52.037071 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cf492d62-38ab-4a1f-b9f5-a51a7985d848 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:52.037677 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cf492d62-38ab-4a1f-b9f5-a51a7985d848 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:52.069021 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-01c0bd07-1727-4d94-9cf4-bcd17d512f16 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:52.070006 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-01c0bd07-1727-4d94-9cf4-bcd17d512f16 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:52.079528 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-01c0bd07-1727-4d94-9cf4-bcd17d512f16 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:52.080228 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-01c0bd07-1727-4d94-9cf4-bcd17d512f16 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:52.081369 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-01c0bd07-1727-4d94-9cf4-bcd17d512f16 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:52.082267 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-01c0bd07-1727-4d94-9cf4-bcd17d512f16 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:52.193139 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-cf492d62-38ab-4a1f-b9f5-a51a7985d848 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 14 microversion: 2.20 time: 0.171370 Aug 27 04:31:52.193776 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 79/151] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:31:52 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 14 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:31:52.233510 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-01c0bd07-1727-4d94-9cf4-bcd17d512f16 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 14 microversion: 2.1 time: 0.168220 Aug 27 04:31:52.234336 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 73/152] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:31:52 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 14 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:31:53.205825 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-6fa62817-98c5-4bcc-bdbc-ca42bbeae46c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:53.206826 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-6fa62817-98c5-4bcc-bdbc-ca42bbeae46c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:53.213958 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6fa62817-98c5-4bcc-bdbc-ca42bbeae46c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:53.214401 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6fa62817-98c5-4bcc-bdbc-ca42bbeae46c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:53.215153 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6fa62817-98c5-4bcc-bdbc-ca42bbeae46c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:53.215834 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6fa62817-98c5-4bcc-bdbc-ca42bbeae46c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:53.249743 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-c44fa5fd-a028-4c38-b63e-39e587c9c77a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:53.249743 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-c44fa5fd-a028-4c38-b63e-39e587c9c77a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:53.257905 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-c44fa5fd-a028-4c38-b63e-39e587c9c77a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:53.258327 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-c44fa5fd-a028-4c38-b63e-39e587c9c77a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:53.259116 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-c44fa5fd-a028-4c38-b63e-39e587c9c77a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:53.259550 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-c44fa5fd-a028-4c38-b63e-39e587c9c77a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:53.366454 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-6fa62817-98c5-4bcc-bdbc-ca42bbeae46c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 14 microversion: 2.20 time: 0.164693 Aug 27 04:31:53.367127 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 80/153] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:31:53 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 14 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:31:53.414384 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-c44fa5fd-a028-4c38-b63e-39e587c9c77a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 14 microversion: 2.1 time: 0.172702 Aug 27 04:31:53.415354 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 74/154] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:31:53 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 14 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 04:31:54.379509 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-55fa3b7a-4222-4dba-a7e4-995e6b5aaa99 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:54.380807 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-55fa3b7a-4222-4dba-a7e4-995e6b5aaa99 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:54.388732 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-55fa3b7a-4222-4dba-a7e4-995e6b5aaa99 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:54.389455 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-55fa3b7a-4222-4dba-a7e4-995e6b5aaa99 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:54.390382 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-55fa3b7a-4222-4dba-a7e4-995e6b5aaa99 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:54.390923 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-55fa3b7a-4222-4dba-a7e4-995e6b5aaa99 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:54.427353 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-65de6424-d88a-4c84-9089-9e332d7a1c0b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:54.428635 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-65de6424-d88a-4c84-9089-9e332d7a1c0b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:54.441992 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-65de6424-d88a-4c84-9089-9e332d7a1c0b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:54.443825 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-65de6424-d88a-4c84-9089-9e332d7a1c0b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:54.444933 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-65de6424-d88a-4c84-9089-9e332d7a1c0b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:54.447182 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-65de6424-d88a-4c84-9089-9e332d7a1c0b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:54.558962 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-55fa3b7a-4222-4dba-a7e4-995e6b5aaa99 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 14 microversion: 2.20 time: 0.183906 Aug 27 04:31:54.559620 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 81/155] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:31:54 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 14 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:54.602506 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-65de6424-d88a-4c84-9089-9e332d7a1c0b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 14 microversion: 2.1 time: 0.179729 Aug 27 04:31:54.603415 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 75/156] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:31:54 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 14 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:31:55.571010 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-52f2e72b-cf66-4c76-8ebb-7cc5f369949d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:55.572013 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-52f2e72b-cf66-4c76-8ebb-7cc5f369949d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:55.578285 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-52f2e72b-cf66-4c76-8ebb-7cc5f369949d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:55.578732 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-52f2e72b-cf66-4c76-8ebb-7cc5f369949d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:55.579503 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-52f2e72b-cf66-4c76-8ebb-7cc5f369949d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:55.579932 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-52f2e72b-cf66-4c76-8ebb-7cc5f369949d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:55.615109 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-c495d231-bedd-4e70-888b-d1b41e479eaa tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:55.616169 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-c495d231-bedd-4e70-888b-d1b41e479eaa tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:55.623243 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-c495d231-bedd-4e70-888b-d1b41e479eaa tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:55.623701 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-c495d231-bedd-4e70-888b-d1b41e479eaa tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:55.624616 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-c495d231-bedd-4e70-888b-d1b41e479eaa tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:55.627386 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-c495d231-bedd-4e70-888b-d1b41e479eaa tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:55.736104 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-52f2e72b-cf66-4c76-8ebb-7cc5f369949d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 14 microversion: 2.20 time: 0.169112 Aug 27 04:31:55.736862 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 82/157] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:31:55 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 14 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:55.783932 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-c495d231-bedd-4e70-888b-d1b41e479eaa tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 3790 microversion: 2.1 time: 0.173247 Aug 27 04:31:55.784586 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 76/158] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:31:55 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 3790 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:56.755969 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-0dfc5834-bff1-426c-9afa-78ba1fc4d1f2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:56.757329 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-0dfc5834-bff1-426c-9afa-78ba1fc4d1f2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:56.765264 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0dfc5834-bff1-426c-9afa-78ba1fc4d1f2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:56.765707 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0dfc5834-bff1-426c-9afa-78ba1fc4d1f2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:56.766494 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0dfc5834-bff1-426c-9afa-78ba1fc4d1f2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:56.766953 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0dfc5834-bff1-426c-9afa-78ba1fc4d1f2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:56.796638 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-03520b43-a29f-4edf-b6bc-e5428534035c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:56.798787 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-03520b43-a29f-4edf-b6bc-e5428534035c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:56.809122 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-03520b43-a29f-4edf-b6bc-e5428534035c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:56.809842 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-03520b43-a29f-4edf-b6bc-e5428534035c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:56.811056 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-03520b43-a29f-4edf-b6bc-e5428534035c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:56.811735 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-03520b43-a29f-4edf-b6bc-e5428534035c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:56.930097 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-0dfc5834-bff1-426c-9afa-78ba1fc4d1f2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 14 microversion: 2.20 time: 0.183678 Aug 27 04:31:56.933844 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 83/159] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:31:56 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 14 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:31:56.986036 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-03520b43-a29f-4edf-b6bc-e5428534035c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 10744 microversion: 2.1 time: 0.193718 Aug 27 04:31:56.986814 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 77/160] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:31:56 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 10744 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:31:57.942083 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-c6cfc7f5-b243-43ac-8c0d-1e7be3a6ade3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:57.943074 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-c6cfc7f5-b243-43ac-8c0d-1e7be3a6ade3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:57.951599 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c6cfc7f5-b243-43ac-8c0d-1e7be3a6ade3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:57.951599 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c6cfc7f5-b243-43ac-8c0d-1e7be3a6ade3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:57.951599 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c6cfc7f5-b243-43ac-8c0d-1e7be3a6ade3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:57.952124 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c6cfc7f5-b243-43ac-8c0d-1e7be3a6ade3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:57.997910 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-f2e5d994-b947-429f-bf2e-6df33620e993 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:31:57.998889 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-f2e5d994-b947-429f-bf2e-6df33620e993 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:31:58.005347 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f2e5d994-b947-429f-bf2e-6df33620e993 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:58.005790 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f2e5d994-b947-429f-bf2e-6df33620e993 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:31:58.006568 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f2e5d994-b947-429f-bf2e-6df33620e993 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:31:58.006995 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f2e5d994-b947-429f-bf2e-6df33620e993 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:02.894592 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-f2e5d994-b947-429f-bf2e-6df33620e993 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 19342 microversion: 2.1 time: 4.900806 Aug 27 04:32:02.898969 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 78/161] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:31:57 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 19342 bytes in 4903 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:32:02.933536 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-c6cfc7f5-b243-43ac-8c0d-1e7be3a6ade3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 17808 microversion: 2.20 time: 4.995245 Aug 27 04:32:02.936982 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 84/162] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:31:57 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 17808 bytes in 4997 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:32:03.907103 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-0b4b6b3b-19f3-4ffc-b639-4ac7bf6a93b1 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:03.908152 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-0b4b6b3b-19f3-4ffc-b639-4ac7bf6a93b1 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:03.916424 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0b4b6b3b-19f3-4ffc-b639-4ac7bf6a93b1 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:03.916867 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0b4b6b3b-19f3-4ffc-b639-4ac7bf6a93b1 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:03.917625 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0b4b6b3b-19f3-4ffc-b639-4ac7bf6a93b1 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:03.918526 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0b4b6b3b-19f3-4ffc-b639-4ac7bf6a93b1 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:03.944949 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-45c648cb-4c22-4462-8a71-4ff8f973b37f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:03.946160 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-45c648cb-4c22-4462-8a71-4ff8f973b37f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:03.954096 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-45c648cb-4c22-4462-8a71-4ff8f973b37f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:03.954552 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-45c648cb-4c22-4462-8a71-4ff8f973b37f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:03.955330 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-45c648cb-4c22-4462-8a71-4ff8f973b37f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:03.955802 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-45c648cb-4c22-4462-8a71-4ff8f973b37f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:04.120299 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-0b4b6b3b-19f3-4ffc-b639-4ac7bf6a93b1 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 20188 microversion: 2.1 time: 0.216691 Aug 27 04:32:04.124394 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 79/163] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:32:03 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 20188 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:32:04.148132 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-45c648cb-4c22-4462-8a71-4ff8f973b37f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 17808 microversion: 2.20 time: 0.206478 Aug 27 04:32:04.152261 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 85/164] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:32:03 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 17808 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:32:05.132039 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-6d6c2833-b19d-4ddf-9c49-75465c2d7ef8 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:05.133022 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-6d6c2833-b19d-4ddf-9c49-75465c2d7ef8 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:05.139729 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6d6c2833-b19d-4ddf-9c49-75465c2d7ef8 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:05.140210 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6d6c2833-b19d-4ddf-9c49-75465c2d7ef8 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:05.140962 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6d6c2833-b19d-4ddf-9c49-75465c2d7ef8 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:05.141390 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6d6c2833-b19d-4ddf-9c49-75465c2d7ef8 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:05.160722 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-7a369e45-9fef-4b21-b126-7ce3d7604ce6 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:05.161775 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-7a369e45-9fef-4b21-b126-7ce3d7604ce6 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:05.169047 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7a369e45-9fef-4b21-b126-7ce3d7604ce6 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:05.169503 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7a369e45-9fef-4b21-b126-7ce3d7604ce6 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:05.170265 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7a369e45-9fef-4b21-b126-7ce3d7604ce6 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:05.170692 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7a369e45-9fef-4b21-b126-7ce3d7604ce6 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:05.363051 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-6d6c2833-b19d-4ddf-9c49-75465c2d7ef8 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 21783 microversion: 2.1 time: 0.234890 Aug 27 04:32:05.363705 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 80/165] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:32:05 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 21783 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:32:05.396335 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-7a369e45-9fef-4b21-b126-7ce3d7604ce6 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 19127 microversion: 2.20 time: 0.239496 Aug 27 04:32:05.398341 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 86/166] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:32:05 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 19127 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:32:06.375597 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-775738e5-e623-4edb-9954-45f1a2dc73a2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:06.376661 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-775738e5-e623-4edb-9954-45f1a2dc73a2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:06.383656 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-775738e5-e623-4edb-9954-45f1a2dc73a2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:06.384139 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-775738e5-e623-4edb-9954-45f1a2dc73a2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:06.384897 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-775738e5-e623-4edb-9954-45f1a2dc73a2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:06.385328 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-775738e5-e623-4edb-9954-45f1a2dc73a2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:06.410057 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-0743d0d6-ba39-4dc9-b668-6e17fc5926fe tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:06.411941 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-0743d0d6-ba39-4dc9-b668-6e17fc5926fe tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:06.419531 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0743d0d6-ba39-4dc9-b668-6e17fc5926fe tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:06.419973 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0743d0d6-ba39-4dc9-b668-6e17fc5926fe tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:06.420761 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0743d0d6-ba39-4dc9-b668-6e17fc5926fe tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:06.421189 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0743d0d6-ba39-4dc9-b668-6e17fc5926fe tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:06.898553 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-775738e5-e623-4edb-9954-45f1a2dc73a2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 22996 microversion: 2.1 time: 0.526748 Aug 27 04:32:06.899199 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 81/167] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:32:06 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 22996 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:32:06.904383 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-dc7b7827-2343-464e-8c10-f2cb7f503c39 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:06.904958 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-dc7b7827-2343-464e-8c10-f2cb7f503c39 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] [instance: a71f46a9-4083-4f82-99fe-e020c5d173c2] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:06.911198 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-dc7b7827-2343-464e-8c10-f2cb7f503c39 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:06.911650 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-dc7b7827-2343-464e-8c10-f2cb7f503c39 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:06.912456 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-dc7b7827-2343-464e-8c10-f2cb7f503c39 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:06.912895 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-dc7b7827-2343-464e-8c10-f2cb7f503c39 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:06.940694 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-0743d0d6-ba39-4dc9-b668-6e17fc5926fe tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 20997 microversion: 2.20 time: 0.536085 Aug 27 04:32:06.941430 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 87/168] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:32:06 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 20997 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:32:06.946340 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-dc7b7827-2343-464e-8c10-f2cb7f503c39 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] [instance: a71f46a9-4083-4f82-99fe-e020c5d173c2] Going to try to terminate instance {{(pid=108970) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 04:32:07.047386 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-dc7b7827-2343-464e-8c10-f2cb7f503c39 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] 10.222.0.53 "DELETE /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2" status: 204 len: 0 microversion: 2.1 time: 0.146568 Aug 27 04:32:07.048130 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 82/169] 10.222.0.53 () {58 vars in 1239 bytes} [Fri Aug 27 04:32:06 2021] DELETE /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:32:07.056784 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-299fe044-17a3-4c6d-97ed-9e1c669706db tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:07.057644 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-299fe044-17a3-4c6d-97ed-9e1c669706db tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] [instance: a71f46a9-4083-4f82-99fe-e020c5d173c2] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:07.064819 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-299fe044-17a3-4c6d-97ed-9e1c669706db tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:07.065259 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-299fe044-17a3-4c6d-97ed-9e1c669706db tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:07.066023 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-299fe044-17a3-4c6d-97ed-9e1c669706db tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:07.066447 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-299fe044-17a3-4c6d-97ed-9e1c669706db tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:07.193175 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-299fe044-17a3-4c6d-97ed-9e1c669706db tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e934818a1e974ea1986b07a7d3e78cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90959ac150c48beb4feacbabf64500f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:07.201094 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-299fe044-17a3-4c6d-97ed-9e1c669706db tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] 10.222.0.53 "GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2" status: 200 len: 1553 microversion: 2.1 time: 0.148693 Aug 27 04:32:07.201691 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 88/170] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:32:07 2021] GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2 => generated 1553 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:07.910863 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-640c53c8-003d-43c7-9ef1-dd612da1249b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:07.911777 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-640c53c8-003d-43c7-9ef1-dd612da1249b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:07.919174 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-640c53c8-003d-43c7-9ef1-dd612da1249b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:07.919629 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-640c53c8-003d-43c7-9ef1-dd612da1249b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:07.920430 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-640c53c8-003d-43c7-9ef1-dd612da1249b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:07.920866 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-640c53c8-003d-43c7-9ef1-dd612da1249b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:07.952781 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-6b30c085-bde1-4bb6-9137-348a5fc8ff95 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:07.953908 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-6b30c085-bde1-4bb6-9137-348a5fc8ff95 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:07.960713 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6b30c085-bde1-4bb6-9137-348a5fc8ff95 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:07.962028 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6b30c085-bde1-4bb6-9137-348a5fc8ff95 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:07.962851 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6b30c085-bde1-4bb6-9137-348a5fc8ff95 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:07.963288 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6b30c085-bde1-4bb6-9137-348a5fc8ff95 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:13.861863 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-640c53c8-003d-43c7-9ef1-dd612da1249b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 27523 microversion: 2.1 time: 5.954961 Aug 27 04:32:13.862518 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 83/171] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:32:07 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 27523 bytes in 5957 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:32:13.868054 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-186bc40a-26e6-4f80-9c90-5b3babb1c557 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:13.868749 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-186bc40a-26e6-4f80-9c90-5b3babb1c557 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] [instance: a71f46a9-4083-4f82-99fe-e020c5d173c2] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:13.875271 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-186bc40a-26e6-4f80-9c90-5b3babb1c557 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:13.875717 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-186bc40a-26e6-4f80-9c90-5b3babb1c557 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:13.876518 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-186bc40a-26e6-4f80-9c90-5b3babb1c557 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:13.876956 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-186bc40a-26e6-4f80-9c90-5b3babb1c557 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:13.967815 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-6b30c085-bde1-4bb6-9137-348a5fc8ff95 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 26855 microversion: 2.20 time: 6.019496 Aug 27 04:32:13.971880 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 89/172] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:32:07 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 26855 bytes in 6021 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:32:14.004728 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-186bc40a-26e6-4f80-9c90-5b3babb1c557 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e934818a1e974ea1986b07a7d3e78cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90959ac150c48beb4feacbabf64500f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:14.013232 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-186bc40a-26e6-4f80-9c90-5b3babb1c557 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] 10.222.0.53 "GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2" status: 200 len: 1553 microversion: 2.1 time: 0.149399 Aug 27 04:32:14.013945 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 84/173] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:32:13 2021] GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2 => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:14.873768 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-9669e0ab-4dff-40be-bbf6-8d556ab4bb19 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:14.874749 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-9669e0ab-4dff-40be-bbf6-8d556ab4bb19 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:14.884728 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9669e0ab-4dff-40be-bbf6-8d556ab4bb19 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:14.885295 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9669e0ab-4dff-40be-bbf6-8d556ab4bb19 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:14.886446 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9669e0ab-4dff-40be-bbf6-8d556ab4bb19 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:14.887203 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9669e0ab-4dff-40be-bbf6-8d556ab4bb19 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:14.978670 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-b18a92cb-cb65-431f-9dc0-aa8f50de8796 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:14.979592 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-b18a92cb-cb65-431f-9dc0-aa8f50de8796 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:14.987190 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b18a92cb-cb65-431f-9dc0-aa8f50de8796 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:14.987882 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b18a92cb-cb65-431f-9dc0-aa8f50de8796 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:14.988810 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b18a92cb-cb65-431f-9dc0-aa8f50de8796 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:14.989444 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b18a92cb-cb65-431f-9dc0-aa8f50de8796 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:15.024924 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-9669e0ab-4dff-40be-bbf6-8d556ab4bb19 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 27655 microversion: 2.1 time: 0.155126 Aug 27 04:32:15.026441 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 90/174] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:32:14 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 27655 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:32:15.033060 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-7747b116-b5f7-453b-9c0f-6e74cffdd854 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:15.034247 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-7747b116-b5f7-453b-9c0f-6e74cffdd854 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] [instance: a71f46a9-4083-4f82-99fe-e020c5d173c2] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:15.042194 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7747b116-b5f7-453b-9c0f-6e74cffdd854 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:15.042871 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7747b116-b5f7-453b-9c0f-6e74cffdd854 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:15.043835 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7747b116-b5f7-453b-9c0f-6e74cffdd854 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:15.044304 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7747b116-b5f7-453b-9c0f-6e74cffdd854 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:15.146414 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-b18a92cb-cb65-431f-9dc0-aa8f50de8796 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 27412 microversion: 2.20 time: 0.170909 Aug 27 04:32:15.148332 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 85/175] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:32:14 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 27412 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:32:15.180806 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-7747b116-b5f7-453b-9c0f-6e74cffdd854 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e934818a1e974ea1986b07a7d3e78cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90959ac150c48beb4feacbabf64500f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:15.189485 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-7747b116-b5f7-453b-9c0f-6e74cffdd854 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] 10.222.0.53 "GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2" status: 200 len: 1553 microversion: 2.1 time: 0.161158 Aug 27 04:32:15.190064 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 91/176] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:32:15 2021] GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2 => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:16.037125 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-e401f3fd-fc26-4012-9812-4b8e4bb314e7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:16.038743 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-e401f3fd-fc26-4012-9812-4b8e4bb314e7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:16.045351 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e401f3fd-fc26-4012-9812-4b8e4bb314e7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:16.045853 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e401f3fd-fc26-4012-9812-4b8e4bb314e7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:16.046620 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e401f3fd-fc26-4012-9812-4b8e4bb314e7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:16.047059 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e401f3fd-fc26-4012-9812-4b8e4bb314e7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:16.162342 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-1abe5294-acdb-49e7-9604-3f6c530150b8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:16.164389 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-1abe5294-acdb-49e7-9604-3f6c530150b8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:16.174524 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1abe5294-acdb-49e7-9604-3f6c530150b8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:16.175239 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1abe5294-acdb-49e7-9604-3f6c530150b8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:16.176560 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1abe5294-acdb-49e7-9604-3f6c530150b8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:16.177301 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1abe5294-acdb-49e7-9604-3f6c530150b8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:16.269826 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-e401f3fd-fc26-4012-9812-4b8e4bb314e7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 27886 microversion: 2.1 time: 0.236588 Aug 27 04:32:16.270471 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 86/177] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:32:16 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 27886 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:32:16.277924 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-99e4203d-b8eb-4206-ac25-1423f3165366 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:16.278629 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-99e4203d-b8eb-4206-ac25-1423f3165366 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] [instance: a71f46a9-4083-4f82-99fe-e020c5d173c2] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:16.285096 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-99e4203d-b8eb-4206-ac25-1423f3165366 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:16.285471 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-99e4203d-b8eb-4206-ac25-1423f3165366 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:16.286252 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-99e4203d-b8eb-4206-ac25-1423f3165366 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:16.286687 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-99e4203d-b8eb-4206-ac25-1423f3165366 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:16.362656 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-1abe5294-acdb-49e7-9604-3f6c530150b8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 27583 microversion: 2.20 time: 0.206529 Aug 27 04:32:16.363303 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 92/178] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:32:16 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 27583 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:32:16.424468 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-99e4203d-b8eb-4206-ac25-1423f3165366 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e934818a1e974ea1986b07a7d3e78cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90959ac150c48beb4feacbabf64500f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:16.432686 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-99e4203d-b8eb-4206-ac25-1423f3165366 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] 10.222.0.53 "GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2" status: 200 len: 1553 microversion: 2.1 time: 0.161052 Aug 27 04:32:16.433617 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 87/179] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:32:16 2021] GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2 => generated 1553 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:17.282539 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-c9cfbf3c-8c86-464a-8f3f-f2a239f6adec tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:17.283544 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-c9cfbf3c-8c86-464a-8f3f-f2a239f6adec tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:17.291495 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c9cfbf3c-8c86-464a-8f3f-f2a239f6adec tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:17.291964 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c9cfbf3c-8c86-464a-8f3f-f2a239f6adec tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:17.292979 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c9cfbf3c-8c86-464a-8f3f-f2a239f6adec tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:17.293570 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c9cfbf3c-8c86-464a-8f3f-f2a239f6adec tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:17.378707 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-10c8b699-93ac-45cb-943b-cf484f2865fa tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:17.380828 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-10c8b699-93ac-45cb-943b-cf484f2865fa tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:17.389346 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-10c8b699-93ac-45cb-943b-cf484f2865fa tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:17.397274 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-10c8b699-93ac-45cb-943b-cf484f2865fa tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:17.399024 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-10c8b699-93ac-45cb-943b-cf484f2865fa tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:17.400385 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-10c8b699-93ac-45cb-943b-cf484f2865fa tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:17.460581 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-c9cfbf3c-8c86-464a-8f3f-f2a239f6adec tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28067 microversion: 2.1 time: 0.181178 Aug 27 04:32:17.461684 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 93/180] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:32:17 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28067 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:32:17.466207 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-76973d89-8aec-4eec-930c-a8fd6e6ee03d tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:17.466910 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-76973d89-8aec-4eec-930c-a8fd6e6ee03d tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] [instance: a71f46a9-4083-4f82-99fe-e020c5d173c2] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:17.479015 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-76973d89-8aec-4eec-930c-a8fd6e6ee03d tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:17.479460 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-76973d89-8aec-4eec-930c-a8fd6e6ee03d tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:17.480579 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-76973d89-8aec-4eec-930c-a8fd6e6ee03d tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:17.481018 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-76973d89-8aec-4eec-930c-a8fd6e6ee03d tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:17.629891 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-10c8b699-93ac-45cb-943b-cf484f2865fa tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 27749 microversion: 2.20 time: 0.254042 Aug 27 04:32:17.637337 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 88/181] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:32:17 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 27749 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:32:17.680899 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-76973d89-8aec-4eec-930c-a8fd6e6ee03d tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e934818a1e974ea1986b07a7d3e78cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90959ac150c48beb4feacbabf64500f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:17.693415 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-76973d89-8aec-4eec-930c-a8fd6e6ee03d tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] 10.222.0.53 "GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2" status: 200 len: 1553 microversion: 2.1 time: 0.230981 Aug 27 04:32:17.694312 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 94/182] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:32:17 2021] GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2 => generated 1553 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:18.473808 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-44324a80-c502-4359-9631-aa221ace5983 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:18.475549 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-44324a80-c502-4359-9631-aa221ace5983 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:18.487780 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-44324a80-c502-4359-9631-aa221ace5983 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:18.487780 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-44324a80-c502-4359-9631-aa221ace5983 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:18.488346 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-44324a80-c502-4359-9631-aa221ace5983 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:18.488736 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-44324a80-c502-4359-9631-aa221ace5983 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:18.628208 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-44324a80-c502-4359-9631-aa221ace5983 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28183 microversion: 2.1 time: 0.158745 Aug 27 04:32:18.630178 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 89/183] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:32:18 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:32:18.645348 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-3cffab5e-6140-477d-9387-bea11ad93dca tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:18.646803 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-3cffab5e-6140-477d-9387-bea11ad93dca tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:18.668906 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3cffab5e-6140-477d-9387-bea11ad93dca tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:18.669381 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3cffab5e-6140-477d-9387-bea11ad93dca tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:18.673962 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3cffab5e-6140-477d-9387-bea11ad93dca tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:18.675814 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3cffab5e-6140-477d-9387-bea11ad93dca tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:18.713232 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-691440d6-0336-4cde-8bc4-7477975158b1 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:18.714171 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-691440d6-0336-4cde-8bc4-7477975158b1 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] [instance: a71f46a9-4083-4f82-99fe-e020c5d173c2] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:18.734331 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-691440d6-0336-4cde-8bc4-7477975158b1 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:18.741573 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-691440d6-0336-4cde-8bc4-7477975158b1 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:18.743689 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-691440d6-0336-4cde-8bc4-7477975158b1 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:18.744454 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-691440d6-0336-4cde-8bc4-7477975158b1 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:18.833007 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-691440d6-0336-4cde-8bc4-7477975158b1 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e934818a1e974ea1986b07a7d3e78cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90959ac150c48beb4feacbabf64500f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:18.842064 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-691440d6-0336-4cde-8bc4-7477975158b1 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] 10.222.0.53 "GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2" status: 200 len: 1511 microversion: 2.1 time: 0.134598 Aug 27 04:32:18.844351 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 90/184] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:32:18 2021] GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2 => generated 1511 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:32:18.850049 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [req-a9813287-3772-4c13-ace2-bfd9a5682c61 req-4facc961-0f69-441d-8da1-3dd82b8be064 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a71f46a9-4083-4f82-99fe-e020c5d173c2", "name": "network-vif-deleted", "tag": "901b4a6c-2cea-4fb7-b496-26f960e19750"}]} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:18.853160 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:32:18.853160 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: warnings.warn(msg) Aug 27 04:32:18.865353 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-3cffab5e-6140-477d-9387-bea11ad93dca tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28128 microversion: 2.20 time: 0.223797 Aug 27 04:32:18.867595 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 95/185] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:32:18 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28128 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:32:18.871670 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-a9813287-3772-4c13-ace2-bfd9a5682c61 req-4facc961-0f69-441d-8da1-3dd82b8be064 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:18.872487 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-a9813287-3772-4c13-ace2-bfd9a5682c61 req-4facc961-0f69-441d-8da1-3dd82b8be064 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:18.888374 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.compute.server_external_events [req-a9813287-3772-4c13-ace2-bfd9a5682c61 req-4facc961-0f69-441d-8da1-3dd82b8be064 service nova] Creating event network-vif-deleted:901b4a6c-2cea-4fb7-b496-26f960e19750 for instance a71f46a9-4083-4f82-99fe-e020c5d173c2 on hv-cinder-80403 Aug 27 04:32:18.894632 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [req-a9813287-3772-4c13-ace2-bfd9a5682c61 req-4facc961-0f69-441d-8da1-3dd82b8be064 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050431 Aug 27 04:32:18.896088 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 91/186] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:32:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:19.649935 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-7536d600-74b3-47b9-bbf7-ac1eb4ba3440 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:19.651860 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-7536d600-74b3-47b9-bbf7-ac1eb4ba3440 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:19.658089 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7536d600-74b3-47b9-bbf7-ac1eb4ba3440 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:19.658634 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7536d600-74b3-47b9-bbf7-ac1eb4ba3440 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:19.659561 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7536d600-74b3-47b9-bbf7-ac1eb4ba3440 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:19.660254 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7536d600-74b3-47b9-bbf7-ac1eb4ba3440 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:19.786455 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-7536d600-74b3-47b9-bbf7-ac1eb4ba3440 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28183 microversion: 2.1 time: 0.147923 Aug 27 04:32:19.787203 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 96/187] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:32:19 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:32:19.864818 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-717800ec-7994-4507-b73b-9d06e00304c5 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:19.866726 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-717800ec-7994-4507-b73b-9d06e00304c5 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] [instance: a71f46a9-4083-4f82-99fe-e020c5d173c2] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:19.874018 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-717800ec-7994-4507-b73b-9d06e00304c5 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:19.874686 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-717800ec-7994-4507-b73b-9d06e00304c5 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:19.875640 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-717800ec-7994-4507-b73b-9d06e00304c5 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:19.876355 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-717800ec-7994-4507-b73b-9d06e00304c5 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:19.879908 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-47000ad0-8fea-4ad4-9b94-73ce8ff47aa7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:19.881166 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-47000ad0-8fea-4ad4-9b94-73ce8ff47aa7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:19.893487 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-47000ad0-8fea-4ad4-9b94-73ce8ff47aa7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:19.894249 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-47000ad0-8fea-4ad4-9b94-73ce8ff47aa7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:19.895179 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-47000ad0-8fea-4ad4-9b94-73ce8ff47aa7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:19.896063 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-47000ad0-8fea-4ad4-9b94-73ce8ff47aa7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:19.924752 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-717800ec-7994-4507-b73b-9d06e00304c5 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:19.925145 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-717800ec-7994-4507-b73b-9d06e00304c5 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:19.925613 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.objects.instance [None req-717800ec-7994-4507-b73b-9d06e00304c5 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lazy-loading 'fault' on Instance uuid a71f46a9-4083-4f82-99fe-e020c5d173c2 {{(pid=108970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:32:19.996258 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-717800ec-7994-4507-b73b-9d06e00304c5 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e934818a1e974ea1986b07a7d3e78cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90959ac150c48beb4feacbabf64500f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:20.005683 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-717800ec-7994-4507-b73b-9d06e00304c5 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] 10.222.0.53 "GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2" status: 200 len: 1350 microversion: 2.1 time: 0.145480 Aug 27 04:32:20.006277 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 92/188] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:32:19 2021] GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2 => generated 1350 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:20.023674 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-47000ad0-8fea-4ad4-9b94-73ce8ff47aa7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28128 microversion: 2.20 time: 0.141931 Aug 27 04:32:20.023674 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 97/189] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:32:19 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28128 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:32:20.798158 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-6037bc5f-05bd-485b-8096-e4849045b97c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:20.799080 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-6037bc5f-05bd-485b-8096-e4849045b97c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:20.805154 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6037bc5f-05bd-485b-8096-e4849045b97c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:20.805592 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6037bc5f-05bd-485b-8096-e4849045b97c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:20.806376 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6037bc5f-05bd-485b-8096-e4849045b97c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:20.806812 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6037bc5f-05bd-485b-8096-e4849045b97c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:20.927585 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-6037bc5f-05bd-485b-8096-e4849045b97c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28183 microversion: 2.1 time: 0.132904 Aug 27 04:32:20.931825 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 93/190] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:32:20 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:32:21.026087 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-b7f260ea-5399-4cc7-8c55-e48c9ce3b933 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:21.026791 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-b7f260ea-5399-4cc7-8c55-e48c9ce3b933 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] [instance: a71f46a9-4083-4f82-99fe-e020c5d173c2] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:21.036419 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-7d0762e8-bd93-4dc1-a0fc-f2c03838e198 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:21.037800 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-7d0762e8-bd93-4dc1-a0fc-f2c03838e198 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:21.049584 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b7f260ea-5399-4cc7-8c55-e48c9ce3b933 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:21.050036 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b7f260ea-5399-4cc7-8c55-e48c9ce3b933 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:21.050830 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b7f260ea-5399-4cc7-8c55-e48c9ce3b933 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:21.051268 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b7f260ea-5399-4cc7-8c55-e48c9ce3b933 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:21.056880 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7d0762e8-bd93-4dc1-a0fc-f2c03838e198 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:21.057341 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7d0762e8-bd93-4dc1-a0fc-f2c03838e198 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:21.058129 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7d0762e8-bd93-4dc1-a0fc-f2c03838e198 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:21.058739 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7d0762e8-bd93-4dc1-a0fc-f2c03838e198 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:21.073153 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.wsgi [None req-b7f260ea-5399-4cc7-8c55-e48c9ce3b933 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] HTTP exception thrown: Instance a71f46a9-4083-4f82-99fe-e020c5d173c2 could not be found. Aug 27 04:32:21.074040 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-b7f260ea-5399-4cc7-8c55-e48c9ce3b933 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Returning 404 to user: Instance a71f46a9-4083-4f82-99fe-e020c5d173c2 could not be found. {{(pid=108971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:32:21.075049 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-b7f260ea-5399-4cc7-8c55-e48c9ce3b933 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] 10.222.0.53 "GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2" status: 404 len: 111 microversion: 2.1 time: 0.054466 Aug 27 04:32:21.076123 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 98/191] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:32:21 2021] GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:32:21.189643 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-7d0762e8-bd93-4dc1-a0fc-f2c03838e198 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28128 microversion: 2.20 time: 0.158319 Aug 27 04:32:21.190620 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 94/192] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:32:21 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28128 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:32:21.311319 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-f5532d72-c610-4cd3-b59f-7bd1a60dfc58 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:21.312357 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-f5532d72-c610-4cd3-b59f-7bd1a60dfc58 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] [instance: a71f46a9-4083-4f82-99fe-e020c5d173c2] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:21.319811 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f5532d72-c610-4cd3-b59f-7bd1a60dfc58 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:21.320268 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f5532d72-c610-4cd3-b59f-7bd1a60dfc58 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:21.321650 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f5532d72-c610-4cd3-b59f-7bd1a60dfc58 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:21.322233 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f5532d72-c610-4cd3-b59f-7bd1a60dfc58 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:21.338598 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.wsgi [None req-f5532d72-c610-4cd3-b59f-7bd1a60dfc58 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] HTTP exception thrown: Instance a71f46a9-4083-4f82-99fe-e020c5d173c2 could not be found. Aug 27 04:32:21.338598 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-f5532d72-c610-4cd3-b59f-7bd1a60dfc58 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Returning 404 to user: Instance a71f46a9-4083-4f82-99fe-e020c5d173c2 could not be found. {{(pid=108971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:32:21.338598 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-f5532d72-c610-4cd3-b59f-7bd1a60dfc58 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] 10.222.0.53 "GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033807 Aug 27 04:32:21.339135 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 99/193] 10.222.0.53 () {58 vars in 1302 bytes} [Fri Aug 27 04:32:21 2021] GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:32:21.939347 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-0dc9404f-189e-47cb-b199-890a348fa916 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:21.940395 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-0dc9404f-189e-47cb-b199-890a348fa916 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:21.947150 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0dc9404f-189e-47cb-b199-890a348fa916 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:21.947613 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0dc9404f-189e-47cb-b199-890a348fa916 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:21.948447 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0dc9404f-189e-47cb-b199-890a348fa916 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:21.948887 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0dc9404f-189e-47cb-b199-890a348fa916 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:22.053529 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-0dc9404f-189e-47cb-b199-890a348fa916 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28183 microversion: 2.1 time: 0.118206 Aug 27 04:32:22.054469 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 95/194] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:32:21 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:32:22.202138 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-729c20b8-bdd3-47e2-9408-6e784650680d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:22.203100 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-729c20b8-bdd3-47e2-9408-6e784650680d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:22.210132 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-729c20b8-bdd3-47e2-9408-6e784650680d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:22.210578 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-729c20b8-bdd3-47e2-9408-6e784650680d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:22.211340 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-729c20b8-bdd3-47e2-9408-6e784650680d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:22.211772 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-729c20b8-bdd3-47e2-9408-6e784650680d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:22.323020 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-729c20b8-bdd3-47e2-9408-6e784650680d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28128 microversion: 2.20 time: 0.124413 Aug 27 04:32:22.323874 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 100/195] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:32:22 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28128 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:32:22.599537 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-6360dd4d-ab11-4a35-b347-d5b75d7a0147 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:22.600178 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-6360dd4d-ab11-4a35-b347-d5b75d7a0147 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] [instance: a71f46a9-4083-4f82-99fe-e020c5d173c2] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:22.606814 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6360dd4d-ab11-4a35-b347-d5b75d7a0147 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:22.607260 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6360dd4d-ab11-4a35-b347-d5b75d7a0147 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:22.608069 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6360dd4d-ab11-4a35-b347-d5b75d7a0147 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:22.608516 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6360dd4d-ab11-4a35-b347-d5b75d7a0147 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:22.623581 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.wsgi [None req-6360dd4d-ab11-4a35-b347-d5b75d7a0147 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] HTTP exception thrown: Instance a71f46a9-4083-4f82-99fe-e020c5d173c2 could not be found. Aug 27 04:32:22.624224 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-6360dd4d-ab11-4a35-b347-d5b75d7a0147 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Returning 404 to user: Instance a71f46a9-4083-4f82-99fe-e020c5d173c2 could not be found. {{(pid=108970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:32:22.625061 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-6360dd4d-ab11-4a35-b347-d5b75d7a0147 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] 10.222.0.53 "DELETE /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2" status: 404 len: 111 microversion: 2.1 time: 0.029623 Aug 27 04:32:22.625920 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 96/196] 10.222.0.53 () {58 vars in 1239 bytes} [Fri Aug 27 04:32:22 2021] DELETE /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:32:22.634639 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-be6184c8-bf67-46e0-8fff-c7af3612c5c0 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:22.635609 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-be6184c8-bf67-46e0-8fff-c7af3612c5c0 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] [instance: a71f46a9-4083-4f82-99fe-e020c5d173c2] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:22.642458 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-be6184c8-bf67-46e0-8fff-c7af3612c5c0 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:22.642952 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-be6184c8-bf67-46e0-8fff-c7af3612c5c0 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:22.643946 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-be6184c8-bf67-46e0-8fff-c7af3612c5c0 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:22.644569 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-be6184c8-bf67-46e0-8fff-c7af3612c5c0 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:22.660270 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.wsgi [None req-be6184c8-bf67-46e0-8fff-c7af3612c5c0 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] HTTP exception thrown: Instance a71f46a9-4083-4f82-99fe-e020c5d173c2 could not be found. Aug 27 04:32:22.660870 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-be6184c8-bf67-46e0-8fff-c7af3612c5c0 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] Returning 404 to user: Instance a71f46a9-4083-4f82-99fe-e020c5d173c2 could not be found. {{(pid=108971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:32:22.661741 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-be6184c8-bf67-46e0-8fff-c7af3612c5c0 tempest-DeleteServersTestJSON-340548821 tempest-DeleteServersTestJSON-340548821-project] 10.222.0.53 "GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2" status: 404 len: 111 microversion: 2.1 time: 0.031621 Aug 27 04:32:22.662553 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 101/197] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:32:22 2021] GET /compute/v2.1/servers/a71f46a9-4083-4f82-99fe-e020c5d173c2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:32:23.065888 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-2239d8ac-50b7-49f6-b031-50e12865fda1 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:23.066848 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-2239d8ac-50b7-49f6-b031-50e12865fda1 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:23.073510 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2239d8ac-50b7-49f6-b031-50e12865fda1 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:23.073964 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2239d8ac-50b7-49f6-b031-50e12865fda1 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:23.074732 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2239d8ac-50b7-49f6-b031-50e12865fda1 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:23.075162 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2239d8ac-50b7-49f6-b031-50e12865fda1 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:23.188856 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-2239d8ac-50b7-49f6-b031-50e12865fda1 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28183 microversion: 2.1 time: 0.126324 Aug 27 04:32:23.189509 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 97/198] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:32:23 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:32:23.343213 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-105ebf95-990a-45dc-835c-9edd730d37da tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:23.344161 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-105ebf95-990a-45dc-835c-9edd730d37da tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:23.350586 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-105ebf95-990a-45dc-835c-9edd730d37da tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:23.351022 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-105ebf95-990a-45dc-835c-9edd730d37da tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:23.352063 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-105ebf95-990a-45dc-835c-9edd730d37da tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:23.352699 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-105ebf95-990a-45dc-835c-9edd730d37da tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:23.472363 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-105ebf95-990a-45dc-835c-9edd730d37da tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28128 microversion: 2.20 time: 0.134630 Aug 27 04:32:23.473048 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 102/199] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:32:23 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28128 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:32:24.204353 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-47f1ec3e-23a1-40d7-ac10-9d6789bc7418 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:24.205523 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-47f1ec3e-23a1-40d7-ac10-9d6789bc7418 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:24.213069 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-47f1ec3e-23a1-40d7-ac10-9d6789bc7418 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:24.213531 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-47f1ec3e-23a1-40d7-ac10-9d6789bc7418 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:24.214300 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-47f1ec3e-23a1-40d7-ac10-9d6789bc7418 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:24.214737 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-47f1ec3e-23a1-40d7-ac10-9d6789bc7418 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:24.323153 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-47f1ec3e-23a1-40d7-ac10-9d6789bc7418 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28183 microversion: 2.1 time: 0.125156 Aug 27 04:32:24.324143 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 98/200] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:32:24 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:32:24.485378 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-1b034ecb-ac09-4cca-a2ff-1607273c91e3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:24.486382 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-1b034ecb-ac09-4cca-a2ff-1607273c91e3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:24.494438 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1b034ecb-ac09-4cca-a2ff-1607273c91e3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:24.494829 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1b034ecb-ac09-4cca-a2ff-1607273c91e3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:24.495642 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1b034ecb-ac09-4cca-a2ff-1607273c91e3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:24.496125 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1b034ecb-ac09-4cca-a2ff-1607273c91e3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:24.605876 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-1b034ecb-ac09-4cca-a2ff-1607273c91e3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28128 microversion: 2.20 time: 0.124375 Aug 27 04:32:24.606748 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 103/201] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:32:24 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28128 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:32:25.336869 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-7779f36e-33c5-4872-bc82-a2d0b024b27c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:25.338739 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-7779f36e-33c5-4872-bc82-a2d0b024b27c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:25.361731 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7779f36e-33c5-4872-bc82-a2d0b024b27c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:25.367127 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7779f36e-33c5-4872-bc82-a2d0b024b27c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:25.368378 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7779f36e-33c5-4872-bc82-a2d0b024b27c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:25.370456 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7779f36e-33c5-4872-bc82-a2d0b024b27c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:25.533917 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-7779f36e-33c5-4872-bc82-a2d0b024b27c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28183 microversion: 2.1 time: 0.201520 Aug 27 04:32:25.539322 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 99/202] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:32:25 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28183 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:32:25.619757 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-ddec9695-6d32-4dfd-b443-78d02dea1260 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:25.620794 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-ddec9695-6d32-4dfd-b443-78d02dea1260 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:25.630018 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ddec9695-6d32-4dfd-b443-78d02dea1260 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:25.630478 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ddec9695-6d32-4dfd-b443-78d02dea1260 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:25.631307 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ddec9695-6d32-4dfd-b443-78d02dea1260 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:25.631749 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ddec9695-6d32-4dfd-b443-78d02dea1260 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:25.750926 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-ddec9695-6d32-4dfd-b443-78d02dea1260 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28128 microversion: 2.20 time: 0.136385 Aug 27 04:32:25.752160 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 104/203] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:32:25 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28128 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:32:26.546943 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-a06f5001-ac5c-4895-a3c3-44c233947ea4 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:26.548114 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-a06f5001-ac5c-4895-a3c3-44c233947ea4 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:26.555676 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a06f5001-ac5c-4895-a3c3-44c233947ea4 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:26.556167 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a06f5001-ac5c-4895-a3c3-44c233947ea4 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:26.556970 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a06f5001-ac5c-4895-a3c3-44c233947ea4 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:26.557415 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a06f5001-ac5c-4895-a3c3-44c233947ea4 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:26.693313 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-a06f5001-ac5c-4895-a3c3-44c233947ea4 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28183 microversion: 2.1 time: 0.150138 Aug 27 04:32:26.694983 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 100/204] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:32:26 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:32:26.766981 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-3ddd3445-cd46-4875-aa55-b4ffaa9bb806 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:26.769145 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-3ddd3445-cd46-4875-aa55-b4ffaa9bb806 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:26.781319 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3ddd3445-cd46-4875-aa55-b4ffaa9bb806 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:26.782078 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3ddd3445-cd46-4875-aa55-b4ffaa9bb806 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:26.783151 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3ddd3445-cd46-4875-aa55-b4ffaa9bb806 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:26.783807 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3ddd3445-cd46-4875-aa55-b4ffaa9bb806 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:26.908672 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-3ddd3445-cd46-4875-aa55-b4ffaa9bb806 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28128 microversion: 2.20 time: 0.147673 Aug 27 04:32:26.909780 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 105/205] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:32:26 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28128 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:32:27.713849 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-7b11cfc6-acf9-401c-baab-6246077f576c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:27.715676 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-7b11cfc6-acf9-401c-baab-6246077f576c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:27.728557 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7b11cfc6-acf9-401c-baab-6246077f576c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:27.730062 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7b11cfc6-acf9-401c-baab-6246077f576c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:27.731930 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7b11cfc6-acf9-401c-baab-6246077f576c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:27.732813 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7b11cfc6-acf9-401c-baab-6246077f576c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:27.880557 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-7b11cfc6-acf9-401c-baab-6246077f576c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28183 microversion: 2.1 time: 0.174863 Aug 27 04:32:27.881959 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 101/206] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:32:27 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:32:27.920821 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-20070461-6ad1-4af5-8678-d00d775aec95 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:27.922380 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-20070461-6ad1-4af5-8678-d00d775aec95 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:27.931872 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-20070461-6ad1-4af5-8678-d00d775aec95 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:27.932344 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-20070461-6ad1-4af5-8678-d00d775aec95 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:27.933296 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-20070461-6ad1-4af5-8678-d00d775aec95 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:27.933875 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-20070461-6ad1-4af5-8678-d00d775aec95 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:28.043757 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-20070461-6ad1-4af5-8678-d00d775aec95 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28128 microversion: 2.20 time: 0.126726 Aug 27 04:32:28.044910 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 106/207] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:32:27 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28128 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:32:28.893881 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-1d91c935-7911-4bab-87a8-0aa86ae2041c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:28.895961 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-1d91c935-7911-4bab-87a8-0aa86ae2041c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:28.904914 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1d91c935-7911-4bab-87a8-0aa86ae2041c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:28.905560 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1d91c935-7911-4bab-87a8-0aa86ae2041c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:28.906397 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1d91c935-7911-4bab-87a8-0aa86ae2041c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:28.906846 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1d91c935-7911-4bab-87a8-0aa86ae2041c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:29.034357 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-1d91c935-7911-4bab-87a8-0aa86ae2041c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28183 microversion: 2.1 time: 0.144797 Aug 27 04:32:29.046658 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 102/208] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:32:28 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:32:29.059704 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-ff574c83-dfa8-40c2-b082-f4ed38473565 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:29.062428 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-ff574c83-dfa8-40c2-b082-f4ed38473565 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:29.077297 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ff574c83-dfa8-40c2-b082-f4ed38473565 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:29.080769 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ff574c83-dfa8-40c2-b082-f4ed38473565 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:29.081873 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ff574c83-dfa8-40c2-b082-f4ed38473565 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:29.082410 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ff574c83-dfa8-40c2-b082-f4ed38473565 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:29.208482 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-ff574c83-dfa8-40c2-b082-f4ed38473565 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28128 microversion: 2.20 time: 0.153101 Aug 27 04:32:29.209150 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 107/209] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:32:29 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28128 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:32:29.293360 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-76191ee2-f5b3-4624-a95a-4a26276ca34e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-279520787", "imageRef": "9356e2fa-e55b-41d9-9ca4-53393f2d79fd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5a0eabd0-6457-4c9f-8893-a95600de2933"}]}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:30.060300 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-0f4efa72-8657-4a51-baec-542360b06284 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:30.062162 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-0f4efa72-8657-4a51-baec-542360b06284 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:30.071705 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0f4efa72-8657-4a51-baec-542360b06284 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:30.072288 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0f4efa72-8657-4a51-baec-542360b06284 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:30.073128 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0f4efa72-8657-4a51-baec-542360b06284 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:30.073563 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0f4efa72-8657-4a51-baec-542360b06284 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:30.184899 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-0f4efa72-8657-4a51-baec-542360b06284 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28183 microversion: 2.1 time: 0.133322 Aug 27 04:32:30.185762 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 108/210] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:32:30 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:32:30.221507 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-f9e7b939-4139-4de5-832c-e91dae29effa tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:30.222830 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-f9e7b939-4139-4de5-832c-e91dae29effa tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:30.232524 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f9e7b939-4139-4de5-832c-e91dae29effa tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:30.232972 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f9e7b939-4139-4de5-832c-e91dae29effa tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:30.233750 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f9e7b939-4139-4de5-832c-e91dae29effa tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:30.234189 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f9e7b939-4139-4de5-832c-e91dae29effa tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:30.332310 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-f9e7b939-4139-4de5-832c-e91dae29effa tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28128 microversion: 2.20 time: 0.114975 Aug 27 04:32:30.333089 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 109/211] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:32:30 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28128 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:32:31.079821 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.network.neutron [None req-76191ee2-f5b3-4624-a95a-4a26276ca34e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] validate_networks() for [('5a0eabd0-6457-4c9f-8893-a95600de2933', None, None, None, None, None)] {{(pid=108970) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 04:32:31.199843 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-1ae66997-2f13-4eb0-a799-75a1f88a5952 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:31.201030 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-1ae66997-2f13-4eb0-a799-75a1f88a5952 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:31.209836 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1ae66997-2f13-4eb0-a799-75a1f88a5952 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:31.210585 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1ae66997-2f13-4eb0-a799-75a1f88a5952 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:31.212200 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1ae66997-2f13-4eb0-a799-75a1f88a5952 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:31.212927 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1ae66997-2f13-4eb0-a799-75a1f88a5952 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:31.331359 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-1ae66997-2f13-4eb0-a799-75a1f88a5952 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28183 microversion: 2.1 time: 0.135460 Aug 27 04:32:31.332702 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 110/212] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:32:31 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:32:31.346530 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-83359ba7-ee73-41a0-9d14-0b93373fcb00 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:31.350357 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-83359ba7-ee73-41a0-9d14-0b93373fcb00 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:31.365260 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-83359ba7-ee73-41a0-9d14-0b93373fcb00 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:31.366264 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-83359ba7-ee73-41a0-9d14-0b93373fcb00 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:31.370568 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-83359ba7-ee73-41a0-9d14-0b93373fcb00 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:31.371247 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-83359ba7-ee73-41a0-9d14-0b93373fcb00 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:31.501059 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-83359ba7-ee73-41a0-9d14-0b93373fcb00 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28128 microversion: 2.20 time: 0.158518 Aug 27 04:32:31.505337 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 111/213] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:32:31 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28128 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:32:31.597665 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.virt.hardware [None req-76191ee2-f5b3-4624-a95a-4a26276ca34e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Flavor limits 0:0:0 {{(pid=108970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:32:31.598089 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.virt.hardware [None req-76191ee2-f5b3-4624-a95a-4a26276ca34e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Image limits 0:0:0 {{(pid=108970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:32:31.598565 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.virt.hardware [None req-76191ee2-f5b3-4624-a95a-4a26276ca34e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Flavor pref 0:0:0 {{(pid=108970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:32:31.599004 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.virt.hardware [None req-76191ee2-f5b3-4624-a95a-4a26276ca34e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Image pref 0:0:0 {{(pid=108970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:32:31.599424 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.virt.hardware [None req-76191ee2-f5b3-4624-a95a-4a26276ca34e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:32:31.621829 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-76191ee2-f5b3-4624-a95a-4a26276ca34e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:31.622302 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-76191ee2-f5b3-4624-a95a-4a26276ca34e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:31.623236 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-76191ee2-f5b3-4624-a95a-4a26276ca34e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:31.623568 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-76191ee2-f5b3-4624-a95a-4a26276ca34e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:31.671417 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.quota [None req-76191ee2-f5b3-4624-a95a-4a26276ca34e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Getting quotas for project 9079f423a2eb4541878e236b831b352d. Resources: {'ram', 'cores', 'instances'} {{(pid=108970) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:32:31.676667 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.quota [None req-76191ee2-f5b3-4624-a95a-4a26276ca34e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Getting quotas for user be4f55d0a3b342f09c5881c88f4eb90c and project 9079f423a2eb4541878e236b831b352d. Resources: {'ram', 'cores', 'instances'} {{(pid=108970) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:32:31.689860 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-76191ee2-f5b3-4624-a95a-4a26276ca34e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Going to run 1 instances... {{(pid=108970) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 04:32:31.692342 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-76191ee2-f5b3-4624-a95a-4a26276ca34e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9356e2fa-e55b-41d9-9ca4-53393f2d79fd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 04:32:31.790050 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-76191ee2-f5b3-4624-a95a-4a26276ca34e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.662524 Aug 27 04:32:31.793819 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 103/214] 10.222.0.53 () {60 vars in 1147 bytes} [Fri Aug 27 04:32:29 2021] POST /compute/v2.1/servers => generated 383 bytes in 2665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:32:31.801931 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-8854745e-aaca-47dc-9cb6-d8449144164f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:31.802640 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-8854745e-aaca-47dc-9cb6-d8449144164f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:31.883163 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-8854745e-aaca-47dc-9cb6-d8449144164f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:31.893480 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-8854745e-aaca-47dc-9cb6-d8449144164f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1221 microversion: 2.1 time: 0.094894 Aug 27 04:32:31.894255 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 112/215] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:32:31 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1221 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:32:32.002309 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-69da331f-7238-4a03-892f-227a850db6d2 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1532391688", "imageRef": "9356e2fa-e55b-41d9-9ca4-53393f2d79fd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5a0eabd0-6457-4c9f-8893-a95600de2933"}]}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:32.099540 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.network.neutron [None req-69da331f-7238-4a03-892f-227a850db6d2 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] validate_networks() for [('5a0eabd0-6457-4c9f-8893-a95600de2933', None, None, None, None, None)] {{(pid=108970) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 04:32:32.345604 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-c3a1f497-e2ec-409f-9a9b-53fcd2d7e6af tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:32.347071 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-c3a1f497-e2ec-409f-9a9b-53fcd2d7e6af tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:32.366348 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c3a1f497-e2ec-409f-9a9b-53fcd2d7e6af tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:32.370299 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c3a1f497-e2ec-409f-9a9b-53fcd2d7e6af tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:32.371615 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c3a1f497-e2ec-409f-9a9b-53fcd2d7e6af tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:32.372330 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c3a1f497-e2ec-409f-9a9b-53fcd2d7e6af tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:32.542957 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-c3a1f497-e2ec-409f-9a9b-53fcd2d7e6af tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28183 microversion: 2.1 time: 0.202605 Aug 27 04:32:32.547917 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 113/216] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:32:32 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28183 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:32:32.554261 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-61983aaf-94e9-4017-8241-3ed28e485e25 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:32.563438 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-61983aaf-94e9-4017-8241-3ed28e485e25 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:32.580998 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-61983aaf-94e9-4017-8241-3ed28e485e25 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:32.581389 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-61983aaf-94e9-4017-8241-3ed28e485e25 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:32.582206 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-61983aaf-94e9-4017-8241-3ed28e485e25 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:32.582697 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-61983aaf-94e9-4017-8241-3ed28e485e25 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:32.684691 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.virt.hardware [None req-69da331f-7238-4a03-892f-227a850db6d2 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Flavor limits 0:0:0 {{(pid=108970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:32:32.685078 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.virt.hardware [None req-69da331f-7238-4a03-892f-227a850db6d2 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Image limits 0:0:0 {{(pid=108970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:32:32.685550 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.virt.hardware [None req-69da331f-7238-4a03-892f-227a850db6d2 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Flavor pref 0:0:0 {{(pid=108970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:32:32.686011 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.virt.hardware [None req-69da331f-7238-4a03-892f-227a850db6d2 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Image pref 0:0:0 {{(pid=108970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:32:32.686421 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.virt.hardware [None req-69da331f-7238-4a03-892f-227a850db6d2 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:32:32.696856 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-69da331f-7238-4a03-892f-227a850db6d2 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:32.697311 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-69da331f-7238-4a03-892f-227a850db6d2 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:32.698130 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-69da331f-7238-4a03-892f-227a850db6d2 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:32.698561 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-69da331f-7238-4a03-892f-227a850db6d2 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:32.709674 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-61983aaf-94e9-4017-8241-3ed28e485e25 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28128 microversion: 2.20 time: 0.158278 Aug 27 04:32:32.712069 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 114/217] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:32:32 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28128 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:32:32.722670 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.quota [None req-69da331f-7238-4a03-892f-227a850db6d2 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Getting quotas for project 9079f423a2eb4541878e236b831b352d. Resources: {'ram', 'cores', 'instances'} {{(pid=108970) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:32:32.727839 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.quota [None req-69da331f-7238-4a03-892f-227a850db6d2 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Getting quotas for user be4f55d0a3b342f09c5881c88f4eb90c and project 9079f423a2eb4541878e236b831b352d. Resources: {'ram', 'cores', 'instances'} {{(pid=108970) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:32:32.739361 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-69da331f-7238-4a03-892f-227a850db6d2 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Going to run 1 instances... {{(pid=108970) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 04:32:32.741847 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-69da331f-7238-4a03-892f-227a850db6d2 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9356e2fa-e55b-41d9-9ca4-53393f2d79fd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 04:32:32.809122 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-69da331f-7238-4a03-892f-227a850db6d2 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.822210 Aug 27 04:32:32.809733 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 104/218] 10.222.0.53 () {60 vars in 1147 bytes} [Fri Aug 27 04:32:31 2021] POST /compute/v2.1/servers => generated 383 bytes in 824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:32:32.822601 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-2ab15a0a-971f-4dee-aadd-bf39b7cec1b4 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:32.823303 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-2ab15a0a-971f-4dee-aadd-bf39b7cec1b4 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:32.925160 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-2ab15a0a-971f-4dee-aadd-bf39b7cec1b4 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:32.947627 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-2ab15a0a-971f-4dee-aadd-bf39b7cec1b4 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1222 microversion: 2.1 time: 0.130952 Aug 27 04:32:32.953516 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 115/219] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:32:32 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1222 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:33.560090 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-ac72757f-3d4e-4335-8128-9c53586a8ebb tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:33.561408 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-ac72757f-3d4e-4335-8128-9c53586a8ebb tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:33.573424 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ac72757f-3d4e-4335-8128-9c53586a8ebb tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:33.574201 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ac72757f-3d4e-4335-8128-9c53586a8ebb tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:33.575575 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ac72757f-3d4e-4335-8128-9c53586a8ebb tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:33.576349 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ac72757f-3d4e-4335-8128-9c53586a8ebb tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:33.721658 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-91fdc0c3-53e5-489e-b98f-41a2c344aff1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:33.722612 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-91fdc0c3-53e5-489e-b98f-41a2c344aff1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:33.731215 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-ac72757f-3d4e-4335-8128-9c53586a8ebb tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28183 microversion: 2.1 time: 0.179164 Aug 27 04:32:33.732120 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 105/220] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:32:33 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:32:33.744147 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-91fdc0c3-53e5-489e-b98f-41a2c344aff1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:33.744761 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-91fdc0c3-53e5-489e-b98f-41a2c344aff1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:33.745562 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-91fdc0c3-53e5-489e-b98f-41a2c344aff1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:33.745997 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-91fdc0c3-53e5-489e-b98f-41a2c344aff1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:33.867509 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-91fdc0c3-53e5-489e-b98f-41a2c344aff1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28128 microversion: 2.20 time: 0.149282 Aug 27 04:32:33.871903 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 116/221] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:32:33 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28128 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:32:33.966137 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-ee58f84c-0add-4ac8-a74a-d0b0efe9efe9 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:33.966926 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-ee58f84c-0add-4ac8-a74a-d0b0efe9efe9 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:33.974116 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ee58f84c-0add-4ac8-a74a-d0b0efe9efe9 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:33.975561 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ee58f84c-0add-4ac8-a74a-d0b0efe9efe9 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:33.976871 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ee58f84c-0add-4ac8-a74a-d0b0efe9efe9 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:33.977457 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ee58f84c-0add-4ac8-a74a-d0b0efe9efe9 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:34.084926 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-ee58f84c-0add-4ac8-a74a-d0b0efe9efe9 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:34.094819 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-ee58f84c-0add-4ac8-a74a-d0b0efe9efe9 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1274 microversion: 2.1 time: 0.131553 Aug 27 04:32:34.105615 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 106/222] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:32:33 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1274 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:34.744564 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-2c8fa2ba-1144-4c73-9f91-3f833dcb77e3 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:34.745469 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-2c8fa2ba-1144-4c73-9f91-3f833dcb77e3 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:34.752258 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-2c8fa2ba-1144-4c73-9f91-3f833dcb77e3 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:34.752707 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-2c8fa2ba-1144-4c73-9f91-3f833dcb77e3 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:34.753489 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-2c8fa2ba-1144-4c73-9f91-3f833dcb77e3 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:34.753921 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-2c8fa2ba-1144-4c73-9f91-3f833dcb77e3 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:34.878829 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-a86ed14e-8f00-442f-acda-0f6a80f89209 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:34.880441 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-a86ed14e-8f00-442f-acda-0f6a80f89209 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:34.883771 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-2c8fa2ba-1144-4c73-9f91-3f833dcb77e3 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28183 microversion: 2.1 time: 0.143947 Aug 27 04:32:34.884891 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 117/223] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:32:34 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:32:34.891071 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a86ed14e-8f00-442f-acda-0f6a80f89209 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:34.891527 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a86ed14e-8f00-442f-acda-0f6a80f89209 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:34.892351 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a86ed14e-8f00-442f-acda-0f6a80f89209 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:34.896250 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a86ed14e-8f00-442f-acda-0f6a80f89209 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:35.025162 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-a86ed14e-8f00-442f-acda-0f6a80f89209 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28128 microversion: 2.20 time: 0.149713 Aug 27 04:32:35.026233 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 107/224] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:32:34 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28128 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:32:35.115125 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-bdb3e596-a167-41e6-a640-50e76524cb43 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:35.116734 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-bdb3e596-a167-41e6-a640-50e76524cb43 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:35.123639 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-bdb3e596-a167-41e6-a640-50e76524cb43 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:35.124370 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-bdb3e596-a167-41e6-a640-50e76524cb43 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:35.125303 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-bdb3e596-a167-41e6-a640-50e76524cb43 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:35.125888 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-bdb3e596-a167-41e6-a640-50e76524cb43 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:35.215091 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-bdb3e596-a167-41e6-a640-50e76524cb43 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:35.226120 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-bdb3e596-a167-41e6-a640-50e76524cb43 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1280 microversion: 2.1 time: 0.115416 Aug 27 04:32:35.226860 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 118/225] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:32:35 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1280 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:35.231393 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [req-2e5ecff4-38a4-475c-a632-813baea431f8 req-4d0c09d9-a940-4d20-a7d0-d3a11552e822 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e594817-f3cc-40e6-babe-c736641fb9a9", "tag": "8d848bd3-1806-43f5-a0cc-2ccc980f7264"}]} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:35.232438 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:32:35.232438 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: warnings.warn(msg) Aug 27 04:32:35.246325 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-2e5ecff4-38a4-475c-a632-813baea431f8 req-4d0c09d9-a940-4d20-a7d0-d3a11552e822 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:35.248890 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-2e5ecff4-38a4-475c-a632-813baea431f8 req-4d0c09d9-a940-4d20-a7d0-d3a11552e822 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:35.266981 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.compute.server_external_events [req-2e5ecff4-38a4-475c-a632-813baea431f8 req-4d0c09d9-a940-4d20-a7d0-d3a11552e822 service nova] Creating event network-changed:8d848bd3-1806-43f5-a0cc-2ccc980f7264 for instance 0e594817-f3cc-40e6-babe-c736641fb9a9 on hv-cinder-80403 Aug 27 04:32:35.272559 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [req-2e5ecff4-38a4-475c-a632-813baea431f8 req-4d0c09d9-a940-4d20-a7d0-d3a11552e822 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045896 Aug 27 04:32:35.273169 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 108/226] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:32:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:35.896206 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-615c2ca9-d83c-41f3-a248-b2c14705e4b3 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:35.897170 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-615c2ca9-d83c-41f3-a248-b2c14705e4b3 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:35.903783 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-615c2ca9-d83c-41f3-a248-b2c14705e4b3 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:35.904493 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-615c2ca9-d83c-41f3-a248-b2c14705e4b3 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:35.905769 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-615c2ca9-d83c-41f3-a248-b2c14705e4b3 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:35.906205 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-615c2ca9-d83c-41f3-a248-b2c14705e4b3 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:36.013939 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-615c2ca9-d83c-41f3-a248-b2c14705e4b3 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28183 microversion: 2.1 time: 0.122459 Aug 27 04:32:36.016030 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 119/227] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:32:35 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:32:36.043233 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-5207a655-d446-4b48-9556-be54f924e7c1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:36.045232 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-5207a655-d446-4b48-9556-be54f924e7c1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:36.060631 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5207a655-d446-4b48-9556-be54f924e7c1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:36.061279 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5207a655-d446-4b48-9556-be54f924e7c1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:36.062505 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5207a655-d446-4b48-9556-be54f924e7c1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:36.063079 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5207a655-d446-4b48-9556-be54f924e7c1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:36.189300 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-5207a655-d446-4b48-9556-be54f924e7c1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28128 microversion: 2.20 time: 0.155343 Aug 27 04:32:36.189997 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 109/228] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:32:36 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28128 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:32:36.245227 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-0df3b263-b8dd-4691-8d76-75f06bde2319 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:36.246925 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-0df3b263-b8dd-4691-8d76-75f06bde2319 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:36.256425 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0df3b263-b8dd-4691-8d76-75f06bde2319 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:36.257231 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0df3b263-b8dd-4691-8d76-75f06bde2319 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:36.258304 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0df3b263-b8dd-4691-8d76-75f06bde2319 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:36.258739 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0df3b263-b8dd-4691-8d76-75f06bde2319 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:36.270472 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [req-a7a24985-2812-475d-8ca4-ce4f6854e546 req-126e3e39-9453-4951-8e2a-f1f43609f773 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df8098ad-7c9c-4ba5-992d-392f9cd1742a", "tag": "c3463dab-7cf3-45d8-9707-77a461c168a9"}]} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:36.272500 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:32:36.272500 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: warnings.warn(msg) Aug 27 04:32:36.282249 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-a7a24985-2812-475d-8ca4-ce4f6854e546 req-126e3e39-9453-4951-8e2a-f1f43609f773 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:36.283060 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-a7a24985-2812-475d-8ca4-ce4f6854e546 req-126e3e39-9453-4951-8e2a-f1f43609f773 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:36.305950 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.compute.server_external_events [req-a7a24985-2812-475d-8ca4-ce4f6854e546 req-126e3e39-9453-4951-8e2a-f1f43609f773 service nova] Creating event network-changed:c3463dab-7cf3-45d8-9707-77a461c168a9 for instance df8098ad-7c9c-4ba5-992d-392f9cd1742a on hv-cinder-80403 Aug 27 04:32:36.311965 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [req-a7a24985-2812-475d-8ca4-ce4f6854e546 req-126e3e39-9453-4951-8e2a-f1f43609f773 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049909 Aug 27 04:32:36.312796 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 110/229] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:32:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:36.441583 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-0df3b263-b8dd-4691-8d76-75f06bde2319 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:36.459323 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-0df3b263-b8dd-4691-8d76-75f06bde2319 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1322 microversion: 2.1 time: 0.219957 Aug 27 04:32:36.459949 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 120/230] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:32:36 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:37.026633 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-0dcba0da-1d45-4709-b1c4-7551e9f2fa05 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:37.027639 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-0dcba0da-1d45-4709-b1c4-7551e9f2fa05 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:37.033961 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0dcba0da-1d45-4709-b1c4-7551e9f2fa05 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:37.034410 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0dcba0da-1d45-4709-b1c4-7551e9f2fa05 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:37.035187 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0dcba0da-1d45-4709-b1c4-7551e9f2fa05 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:37.035650 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0dcba0da-1d45-4709-b1c4-7551e9f2fa05 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:37.142228 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-0dcba0da-1d45-4709-b1c4-7551e9f2fa05 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28183 microversion: 2.1 time: 0.119560 Aug 27 04:32:37.144413 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 111/231] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:32:37 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:32:37.199914 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-0e2442e3-0f95-45b0-acd3-83077ef45844 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:37.201159 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-0e2442e3-0f95-45b0-acd3-83077ef45844 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:37.207786 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0e2442e3-0f95-45b0-acd3-83077ef45844 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:37.208351 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0e2442e3-0f95-45b0-acd3-83077ef45844 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:37.209750 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0e2442e3-0f95-45b0-acd3-83077ef45844 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:37.210594 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0e2442e3-0f95-45b0-acd3-83077ef45844 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:37.324248 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-0e2442e3-0f95-45b0-acd3-83077ef45844 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28128 microversion: 2.20 time: 0.127823 Aug 27 04:32:37.324958 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 121/232] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:32:37 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28128 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:32:37.476195 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-a42bc5e2-6b1a-4e24-aa1c-116b7d8646d1 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:37.476896 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-a42bc5e2-6b1a-4e24-aa1c-116b7d8646d1 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:37.483519 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a42bc5e2-6b1a-4e24-aa1c-116b7d8646d1 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:37.483975 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a42bc5e2-6b1a-4e24-aa1c-116b7d8646d1 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:37.484781 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a42bc5e2-6b1a-4e24-aa1c-116b7d8646d1 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:37.485224 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a42bc5e2-6b1a-4e24-aa1c-116b7d8646d1 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:37.618240 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-a42bc5e2-6b1a-4e24-aa1c-116b7d8646d1 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:37.625824 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-a42bc5e2-6b1a-4e24-aa1c-116b7d8646d1 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1322 microversion: 2.1 time: 0.153658 Aug 27 04:32:37.626390 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 112/233] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:32:37 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:38.155148 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-780fa74a-f6c6-4fc4-947b-3d095e8addd7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:38.156176 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-780fa74a-f6c6-4fc4-947b-3d095e8addd7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:38.162938 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-780fa74a-f6c6-4fc4-947b-3d095e8addd7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:38.163389 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-780fa74a-f6c6-4fc4-947b-3d095e8addd7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:38.164206 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-780fa74a-f6c6-4fc4-947b-3d095e8addd7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:38.164640 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-780fa74a-f6c6-4fc4-947b-3d095e8addd7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:38.286791 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-780fa74a-f6c6-4fc4-947b-3d095e8addd7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28183 microversion: 2.1 time: 0.135508 Aug 27 04:32:38.291048 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 122/234] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:32:38 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:32:38.337543 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-e884ba06-e3e1-4f0e-b98c-a30a9e6f1500 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:38.338466 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-e884ba06-e3e1-4f0e-b98c-a30a9e6f1500 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:38.344388 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e884ba06-e3e1-4f0e-b98c-a30a9e6f1500 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:38.344841 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e884ba06-e3e1-4f0e-b98c-a30a9e6f1500 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:38.345864 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e884ba06-e3e1-4f0e-b98c-a30a9e6f1500 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:38.346065 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e884ba06-e3e1-4f0e-b98c-a30a9e6f1500 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:38.451342 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-e884ba06-e3e1-4f0e-b98c-a30a9e6f1500 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28128 microversion: 2.20 time: 0.118871 Aug 27 04:32:38.452440 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 113/235] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:32:38 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28128 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:32:38.650051 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-056f207a-2198-45ea-8e3b-d8f83fb4f031 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:38.650978 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-056f207a-2198-45ea-8e3b-d8f83fb4f031 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:38.663192 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-056f207a-2198-45ea-8e3b-d8f83fb4f031 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:38.663192 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-056f207a-2198-45ea-8e3b-d8f83fb4f031 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:38.663192 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-056f207a-2198-45ea-8e3b-d8f83fb4f031 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:38.663192 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-056f207a-2198-45ea-8e3b-d8f83fb4f031 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:38.805085 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-056f207a-2198-45ea-8e3b-d8f83fb4f031 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:38.812993 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-056f207a-2198-45ea-8e3b-d8f83fb4f031 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1322 microversion: 2.1 time: 0.168422 Aug 27 04:32:38.813692 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 123/236] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:32:38 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:39.299445 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-285de576-f7ba-40b6-a3b1-fc6646c7fc0a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:39.300800 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-285de576-f7ba-40b6-a3b1-fc6646c7fc0a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:39.307444 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-285de576-f7ba-40b6-a3b1-fc6646c7fc0a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:39.307899 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-285de576-f7ba-40b6-a3b1-fc6646c7fc0a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:39.308717 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-285de576-f7ba-40b6-a3b1-fc6646c7fc0a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:39.309161 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-285de576-f7ba-40b6-a3b1-fc6646c7fc0a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:39.424081 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-285de576-f7ba-40b6-a3b1-fc6646c7fc0a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28183 microversion: 2.1 time: 0.128470 Aug 27 04:32:39.425486 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 114/237] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:32:39 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:32:39.463386 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-5e3afc48-8485-44a7-92b8-a8b45a9ec739 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:39.464288 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-5e3afc48-8485-44a7-92b8-a8b45a9ec739 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:39.470842 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5e3afc48-8485-44a7-92b8-a8b45a9ec739 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:39.471292 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5e3afc48-8485-44a7-92b8-a8b45a9ec739 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:39.472109 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5e3afc48-8485-44a7-92b8-a8b45a9ec739 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:39.472550 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5e3afc48-8485-44a7-92b8-a8b45a9ec739 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:39.580107 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-5e3afc48-8485-44a7-92b8-a8b45a9ec739 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28128 microversion: 2.20 time: 0.120478 Aug 27 04:32:39.580221 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 124/238] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:32:39 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28128 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:32:39.831452 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-23bde159-b4eb-4737-8feb-74c522fc035f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:39.832175 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-23bde159-b4eb-4737-8feb-74c522fc035f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:39.840620 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-23bde159-b4eb-4737-8feb-74c522fc035f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:39.841077 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-23bde159-b4eb-4737-8feb-74c522fc035f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:39.841873 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-23bde159-b4eb-4737-8feb-74c522fc035f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:39.842335 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-23bde159-b4eb-4737-8feb-74c522fc035f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:39.988299 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-23bde159-b4eb-4737-8feb-74c522fc035f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:39.997445 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-23bde159-b4eb-4737-8feb-74c522fc035f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1322 microversion: 2.1 time: 0.170065 Aug 27 04:32:39.998033 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 115/239] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:32:39 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:40.436751 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-6568e373-7be1-4e38-865f-be9e0310cc55 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:40.437820 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-6568e373-7be1-4e38-865f-be9e0310cc55 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:40.444850 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6568e373-7be1-4e38-865f-be9e0310cc55 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:40.445296 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6568e373-7be1-4e38-865f-be9e0310cc55 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:40.446176 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6568e373-7be1-4e38-865f-be9e0310cc55 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:40.446610 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6568e373-7be1-4e38-865f-be9e0310cc55 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:40.591295 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-e7fa0bee-ab55-4e24-869f-cc9be561707e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:40.592229 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-e7fa0bee-ab55-4e24-869f-cc9be561707e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:40.598384 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e7fa0bee-ab55-4e24-869f-cc9be561707e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:40.598830 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e7fa0bee-ab55-4e24-869f-cc9be561707e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:40.599627 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e7fa0bee-ab55-4e24-869f-cc9be561707e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:40.600237 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e7fa0bee-ab55-4e24-869f-cc9be561707e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:40.614662 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-6568e373-7be1-4e38-865f-be9e0310cc55 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28183 microversion: 2.1 time: 0.181712 Aug 27 04:32:40.615306 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 125/240] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:32:40 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:32:40.699760 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-e7fa0bee-ab55-4e24-869f-cc9be561707e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28128 microversion: 2.20 time: 0.112001 Aug 27 04:32:40.700513 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 116/241] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:32:40 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28128 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:32:41.015541 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-d8f926df-ce0b-4c4d-a2f8-726501899d32 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:41.017664 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-d8f926df-ce0b-4c4d-a2f8-726501899d32 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:41.023510 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d8f926df-ce0b-4c4d-a2f8-726501899d32 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:41.023957 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d8f926df-ce0b-4c4d-a2f8-726501899d32 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:41.024772 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d8f926df-ce0b-4c4d-a2f8-726501899d32 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:41.025338 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d8f926df-ce0b-4c4d-a2f8-726501899d32 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:41.151764 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-d8f926df-ce0b-4c4d-a2f8-726501899d32 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:41.159236 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-d8f926df-ce0b-4c4d-a2f8-726501899d32 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1322 microversion: 2.1 time: 0.147573 Aug 27 04:32:41.159809 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 126/242] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:32:41 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:41.627593 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-158f72be-ff6a-4f0b-a471-a3ae665fcf9b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:41.628634 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-158f72be-ff6a-4f0b-a471-a3ae665fcf9b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:41.635866 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-158f72be-ff6a-4f0b-a471-a3ae665fcf9b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:41.636347 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-158f72be-ff6a-4f0b-a471-a3ae665fcf9b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:41.637149 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-158f72be-ff6a-4f0b-a471-a3ae665fcf9b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:41.637620 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-158f72be-ff6a-4f0b-a471-a3ae665fcf9b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:41.711777 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-9cca00f7-5e00-4162-be86-067e6e749778 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:41.712719 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-9cca00f7-5e00-4162-be86-067e6e749778 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:41.718720 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9cca00f7-5e00-4162-be86-067e6e749778 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:41.719170 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9cca00f7-5e00-4162-be86-067e6e749778 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:41.719943 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9cca00f7-5e00-4162-be86-067e6e749778 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:41.720403 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9cca00f7-5e00-4162-be86-067e6e749778 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:41.749184 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-158f72be-ff6a-4f0b-a471-a3ae665fcf9b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28183 microversion: 2.1 time: 0.125243 Aug 27 04:32:41.750045 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 117/243] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:32:41 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:32:41.830749 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-9cca00f7-5e00-4162-be86-067e6e749778 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28128 microversion: 2.20 time: 0.123024 Aug 27 04:32:41.831401 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 127/244] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:32:41 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28128 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:32:42.178793 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-c43592ee-0ce4-4bf8-a87a-be6412974e8f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:42.179501 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-c43592ee-0ce4-4bf8-a87a-be6412974e8f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:42.186307 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-c43592ee-0ce4-4bf8-a87a-be6412974e8f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:42.186764 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-c43592ee-0ce4-4bf8-a87a-be6412974e8f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:42.187561 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-c43592ee-0ce4-4bf8-a87a-be6412974e8f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:42.188018 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-c43592ee-0ce4-4bf8-a87a-be6412974e8f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:42.312993 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-c43592ee-0ce4-4bf8-a87a-be6412974e8f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:42.321305 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-c43592ee-0ce4-4bf8-a87a-be6412974e8f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1322 microversion: 2.1 time: 0.147370 Aug 27 04:32:42.321885 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 118/245] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:32:42 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:42.763107 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-26f321af-a3f5-417f-8c1a-4e7b7c42d6c7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:42.764145 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-26f321af-a3f5-417f-8c1a-4e7b7c42d6c7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:42.770451 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-26f321af-a3f5-417f-8c1a-4e7b7c42d6c7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:42.770891 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-26f321af-a3f5-417f-8c1a-4e7b7c42d6c7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:42.771653 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-26f321af-a3f5-417f-8c1a-4e7b7c42d6c7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:42.772108 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-26f321af-a3f5-417f-8c1a-4e7b7c42d6c7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:42.850687 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-f9be7dd8-99af-4062-b14f-950b5ef33607 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:42.851598 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-f9be7dd8-99af-4062-b14f-950b5ef33607 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:42.857905 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f9be7dd8-99af-4062-b14f-950b5ef33607 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:42.858355 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f9be7dd8-99af-4062-b14f-950b5ef33607 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:42.859132 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f9be7dd8-99af-4062-b14f-950b5ef33607 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:42.859567 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f9be7dd8-99af-4062-b14f-950b5ef33607 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:42.872318 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-26f321af-a3f5-417f-8c1a-4e7b7c42d6c7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28183 microversion: 2.1 time: 0.112581 Aug 27 04:32:42.873822 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 128/246] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:32:42 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:32:42.973011 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-f9be7dd8-99af-4062-b14f-950b5ef33607 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28128 microversion: 2.20 time: 0.126312 Aug 27 04:32:42.973565 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 119/247] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:32:42 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28128 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:32:43.163310 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-cb11c116-8554-4815-ab31-1b9843c388fa tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2137876256", "imageRef": "9356e2fa-e55b-41d9-9ca4-53393f2d79fd", "flavorRef": "452"}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:43.262549 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.network.neutron [None req-cb11c116-8554-4815-ab31-1b9843c388fa tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] validate_networks() for None {{(pid=108971) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 04:32:43.339684 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-e3c6c2c2-2ee2-449b-8018-ceca26f8aa19 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:43.340399 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-e3c6c2c2-2ee2-449b-8018-ceca26f8aa19 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:43.347394 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e3c6c2c2-2ee2-449b-8018-ceca26f8aa19 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:43.347623 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e3c6c2c2-2ee2-449b-8018-ceca26f8aa19 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:43.348379 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e3c6c2c2-2ee2-449b-8018-ceca26f8aa19 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:43.348814 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e3c6c2c2-2ee2-449b-8018-ceca26f8aa19 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:43.487193 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-e3c6c2c2-2ee2-449b-8018-ceca26f8aa19 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:43.496116 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-e3c6c2c2-2ee2-449b-8018-ceca26f8aa19 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1322 microversion: 2.1 time: 0.160029 Aug 27 04:32:43.496397 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 120/248] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:32:43 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:43.548843 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.virt.hardware [None req-cb11c116-8554-4815-ab31-1b9843c388fa tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Flavor limits 0:0:0 {{(pid=108971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:32:43.549252 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.virt.hardware [None req-cb11c116-8554-4815-ab31-1b9843c388fa tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Image limits 0:0:0 {{(pid=108971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:32:43.549712 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.virt.hardware [None req-cb11c116-8554-4815-ab31-1b9843c388fa tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Flavor pref 0:0:0 {{(pid=108971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:32:43.550108 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.virt.hardware [None req-cb11c116-8554-4815-ab31-1b9843c388fa tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Image pref 0:0:0 {{(pid=108971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:32:43.550505 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.virt.hardware [None req-cb11c116-8554-4815-ab31-1b9843c388fa tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:32:43.559588 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cb11c116-8554-4815-ab31-1b9843c388fa tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:43.560050 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cb11c116-8554-4815-ab31-1b9843c388fa tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:43.560841 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cb11c116-8554-4815-ab31-1b9843c388fa tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:43.561266 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cb11c116-8554-4815-ab31-1b9843c388fa tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:43.580993 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.quota [None req-cb11c116-8554-4815-ab31-1b9843c388fa tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Getting quotas for project d7de2692ad114448ab4ce22c9e152f1d. Resources: {'ram', 'cores', 'instances'} {{(pid=108971) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:32:43.585753 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.quota [None req-cb11c116-8554-4815-ab31-1b9843c388fa tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Getting quotas for user 54606e59672042dcbd37209fce5267fe and project d7de2692ad114448ab4ce22c9e152f1d. Resources: {'ram', 'cores', 'instances'} {{(pid=108971) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:32:43.598062 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-cb11c116-8554-4815-ab31-1b9843c388fa tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Going to run 1 instances... {{(pid=108971) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 04:32:43.600515 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-cb11c116-8554-4815-ab31-1b9843c388fa tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] [instance: a2ceae33-b8b9-4fe9-b507-4edb7d4a5403] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9356e2fa-e55b-41d9-9ca4-53393f2d79fd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 04:32:43.645154 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-cb11c116-8554-4815-ab31-1b9843c388fa tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] 10.222.0.53 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.486884 Aug 27 04:32:43.645797 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 129/249] 10.222.0.53 () {60 vars in 1147 bytes} [Fri Aug 27 04:32:43 2021] POST /compute/v2.1/servers => generated 380 bytes in 488 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:32:43.655869 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-fb5f995f-51de-4dbc-a0f7-f6979c4fbcfd tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:43.656515 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-fb5f995f-51de-4dbc-a0f7-f6979c4fbcfd tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] [instance: a2ceae33-b8b9-4fe9-b507-4edb7d4a5403] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:43.708059 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-fb5f995f-51de-4dbc-a0f7-f6979c4fbcfd tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54606e59672042dcbd37209fce5267fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7de2692ad114448ab4ce22c9e152f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:43.716205 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-fb5f995f-51de-4dbc-a0f7-f6979c4fbcfd tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] 10.222.0.53 "GET /compute/v2.1/servers/a2ceae33-b8b9-4fe9-b507-4edb7d4a5403" status: 200 len: 1215 microversion: 2.1 time: 0.063797 Aug 27 04:32:43.717241 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 121/250] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:32:43 2021] GET /compute/v2.1/servers/a2ceae33-b8b9-4fe9-b507-4edb7d4a5403 => generated 1215 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:43.892017 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-2e072bb7-09eb-4f3b-9316-e46eb1b92e63 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:43.892017 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-2e072bb7-09eb-4f3b-9316-e46eb1b92e63 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:43.910151 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-2e072bb7-09eb-4f3b-9316-e46eb1b92e63 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:43.910667 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-2e072bb7-09eb-4f3b-9316-e46eb1b92e63 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:43.911449 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-2e072bb7-09eb-4f3b-9316-e46eb1b92e63 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:43.911874 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-2e072bb7-09eb-4f3b-9316-e46eb1b92e63 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:43.986205 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-13175221-42d6-4e62-b7a5-e6f3ada0c6e8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:43.987193 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-13175221-42d6-4e62-b7a5-e6f3ada0c6e8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:43.994725 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-13175221-42d6-4e62-b7a5-e6f3ada0c6e8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:43.995180 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-13175221-42d6-4e62-b7a5-e6f3ada0c6e8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:43.996027 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-13175221-42d6-4e62-b7a5-e6f3ada0c6e8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:43.996698 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-13175221-42d6-4e62-b7a5-e6f3ada0c6e8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:44.034728 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-2e072bb7-09eb-4f3b-9316-e46eb1b92e63 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28183 microversion: 2.1 time: 0.152065 Aug 27 04:32:44.038643 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 130/251] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:32:43 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:32:44.127538 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-13175221-42d6-4e62-b7a5-e6f3ada0c6e8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28128 microversion: 2.20 time: 0.145577 Aug 27 04:32:44.128213 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 122/252] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:32:43 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28128 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:32:44.517558 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-3246b132-64cb-4e5f-bdf3-7566897bc57c tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:44.518260 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-3246b132-64cb-4e5f-bdf3-7566897bc57c tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:44.526069 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3246b132-64cb-4e5f-bdf3-7566897bc57c tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:44.526507 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3246b132-64cb-4e5f-bdf3-7566897bc57c tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:44.527277 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3246b132-64cb-4e5f-bdf3-7566897bc57c tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:44.527700 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3246b132-64cb-4e5f-bdf3-7566897bc57c tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:44.654251 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-3246b132-64cb-4e5f-bdf3-7566897bc57c tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:44.662318 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-3246b132-64cb-4e5f-bdf3-7566897bc57c tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1322 microversion: 2.1 time: 0.148033 Aug 27 04:32:44.662794 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 131/253] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:32:44 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:44.734093 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-74106091-c16c-460f-9913-4e589c72c9bc tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:44.734799 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-74106091-c16c-460f-9913-4e589c72c9bc tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] [instance: a2ceae33-b8b9-4fe9-b507-4edb7d4a5403] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:44.741446 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-74106091-c16c-460f-9913-4e589c72c9bc tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:44.741905 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-74106091-c16c-460f-9913-4e589c72c9bc tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:44.742681 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-74106091-c16c-460f-9913-4e589c72c9bc tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:44.743141 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-74106091-c16c-460f-9913-4e589c72c9bc tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:44.804783 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-74106091-c16c-460f-9913-4e589c72c9bc tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54606e59672042dcbd37209fce5267fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7de2692ad114448ab4ce22c9e152f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:44.815598 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-74106091-c16c-460f-9913-4e589c72c9bc tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] 10.222.0.53 "GET /compute/v2.1/servers/a2ceae33-b8b9-4fe9-b507-4edb7d4a5403" status: 200 len: 1267 microversion: 2.1 time: 0.082720 Aug 27 04:32:44.815598 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 123/254] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:32:44 2021] GET /compute/v2.1/servers/a2ceae33-b8b9-4fe9-b507-4edb7d4a5403 => generated 1267 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:45.046216 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-631cf20d-dc6b-4b34-ae8c-f4601dfb4820 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:45.047332 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-631cf20d-dc6b-4b34-ae8c-f4601dfb4820 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:45.053429 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-631cf20d-dc6b-4b34-ae8c-f4601dfb4820 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:45.053875 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-631cf20d-dc6b-4b34-ae8c-f4601dfb4820 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:45.054653 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-631cf20d-dc6b-4b34-ae8c-f4601dfb4820 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:45.055084 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-631cf20d-dc6b-4b34-ae8c-f4601dfb4820 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:45.138894 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-9d511d66-b855-4841-b563-68c89c79b18a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:45.139808 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-9d511d66-b855-4841-b563-68c89c79b18a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:45.146124 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9d511d66-b855-4841-b563-68c89c79b18a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:45.147246 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9d511d66-b855-4841-b563-68c89c79b18a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:45.148056 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9d511d66-b855-4841-b563-68c89c79b18a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:45.148487 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9d511d66-b855-4841-b563-68c89c79b18a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:45.871729 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-631cf20d-dc6b-4b34-ae8c-f4601dfb4820 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28474 microversion: 2.1 time: 0.828982 Aug 27 04:32:45.872456 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 132/255] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:32:45 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28474 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:32:45.879816 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-fb632924-1831-4a3f-8653-bffbd72724eb tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:45.880583 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-fb632924-1831-4a3f-8653-bffbd72724eb tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:45.886769 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-fb632924-1831-4a3f-8653-bffbd72724eb tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:45.887220 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-fb632924-1831-4a3f-8653-bffbd72724eb tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:45.888032 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-fb632924-1831-4a3f-8653-bffbd72724eb tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:45.888473 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-fb632924-1831-4a3f-8653-bffbd72724eb tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:45.910991 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-9d511d66-b855-4841-b563-68c89c79b18a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28128 microversion: 2.20 time: 0.775699 Aug 27 04:32:45.912599 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 124/256] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:32:45 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28128 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:32:45.917936 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-74189d63-f410-459e-a3c1-f09dfbaae08c tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:45.918756 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-74189d63-f410-459e-a3c1-f09dfbaae08c tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] [instance: a2ceae33-b8b9-4fe9-b507-4edb7d4a5403] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:45.925730 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-74189d63-f410-459e-a3c1-f09dfbaae08c tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:45.926283 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-74189d63-f410-459e-a3c1-f09dfbaae08c tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:45.927142 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-74189d63-f410-459e-a3c1-f09dfbaae08c tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:45.928434 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-74189d63-f410-459e-a3c1-f09dfbaae08c tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:46.000194 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-74189d63-f410-459e-a3c1-f09dfbaae08c tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54606e59672042dcbd37209fce5267fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7de2692ad114448ab4ce22c9e152f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:46.007861 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-74189d63-f410-459e-a3c1-f09dfbaae08c tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] 10.222.0.53 "GET /compute/v2.1/servers/a2ceae33-b8b9-4fe9-b507-4edb7d4a5403" status: 200 len: 1273 microversion: 2.1 time: 0.093801 Aug 27 04:32:46.008479 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 125/257] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:32:45 2021] GET /compute/v2.1/servers/a2ceae33-b8b9-4fe9-b507-4edb7d4a5403 => generated 1273 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:46.085801 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-fb632924-1831-4a3f-8653-bffbd72724eb tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:46.093555 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-fb632924-1831-4a3f-8653-bffbd72724eb tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1322 microversion: 2.1 time: 0.219582 Aug 27 04:32:46.094288 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 133/258] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:32:45 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:46.877517 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [req-b980fedc-371f-436d-8fc3-fd38518b5679 req-dc4d3331-f535-4570-b7ef-8b5280d0dc00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2ceae33-b8b9-4fe9-b507-4edb7d4a5403", "tag": "ca061db2-994e-4835-9544-62ab84abf718"}]} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:46.886013 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-eb008383-61be-48b3-8e3c-a1c9ad4ad06c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:46.886456 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:32:46.886456 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: warnings.warn(msg) Aug 27 04:32:46.886846 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-eb008383-61be-48b3-8e3c-a1c9ad4ad06c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:46.899835 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-eb008383-61be-48b3-8e3c-a1c9ad4ad06c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:46.900219 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-eb008383-61be-48b3-8e3c-a1c9ad4ad06c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:46.900800 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-b980fedc-371f-436d-8fc3-fd38518b5679 req-dc4d3331-f535-4570-b7ef-8b5280d0dc00 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:46.900982 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-eb008383-61be-48b3-8e3c-a1c9ad4ad06c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:46.902396 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-b980fedc-371f-436d-8fc3-fd38518b5679 req-dc4d3331-f535-4570-b7ef-8b5280d0dc00 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:46.903794 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-eb008383-61be-48b3-8e3c-a1c9ad4ad06c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:46.932992 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.compute.server_external_events [req-b980fedc-371f-436d-8fc3-fd38518b5679 req-dc4d3331-f535-4570-b7ef-8b5280d0dc00 service nova] Creating event network-changed:ca061db2-994e-4835-9544-62ab84abf718 for instance a2ceae33-b8b9-4fe9-b507-4edb7d4a5403 on hv-cinder-80403 Aug 27 04:32:46.939279 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [req-b980fedc-371f-436d-8fc3-fd38518b5679 req-dc4d3331-f535-4570-b7ef-8b5280d0dc00 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070400 Aug 27 04:32:46.940178 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 126/259] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:32:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:46.947352 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-2e2fd0d0-4c7a-4d96-a2a9-6bd8d4fe8454 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:46.948382 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-2e2fd0d0-4c7a-4d96-a2a9-6bd8d4fe8454 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:46.955127 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2e2fd0d0-4c7a-4d96-a2a9-6bd8d4fe8454 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:46.955585 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2e2fd0d0-4c7a-4d96-a2a9-6bd8d4fe8454 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:46.956400 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2e2fd0d0-4c7a-4d96-a2a9-6bd8d4fe8454 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:46.956835 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2e2fd0d0-4c7a-4d96-a2a9-6bd8d4fe8454 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:47.153206 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-eb008383-61be-48b3-8e3c-a1c9ad4ad06c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28474 microversion: 2.1 time: 0.272946 Aug 27 04:32:47.153864 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 134/260] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:32:46 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28474 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:32:47.158818 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-43264b92-89b4-4e1a-89bb-04a0259aa545 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:47.159512 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-43264b92-89b4-4e1a-89bb-04a0259aa545 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] [instance: a2ceae33-b8b9-4fe9-b507-4edb7d4a5403] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:47.166692 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-43264b92-89b4-4e1a-89bb-04a0259aa545 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:47.167134 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-43264b92-89b4-4e1a-89bb-04a0259aa545 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:47.167905 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-43264b92-89b4-4e1a-89bb-04a0259aa545 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:47.168379 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-43264b92-89b4-4e1a-89bb-04a0259aa545 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:47.208185 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-2e2fd0d0-4c7a-4d96-a2a9-6bd8d4fe8454 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28417 microversion: 2.20 time: 0.265883 Aug 27 04:32:47.212107 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 127/261] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:32:46 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28417 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:32:47.214007 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-f48e3033-c602-49bd-9e25-1d94b462a9e4 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:47.214727 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-f48e3033-c602-49bd-9e25-1d94b462a9e4 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:47.221381 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f48e3033-c602-49bd-9e25-1d94b462a9e4 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:47.221834 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f48e3033-c602-49bd-9e25-1d94b462a9e4 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:47.222615 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f48e3033-c602-49bd-9e25-1d94b462a9e4 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:47.223059 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f48e3033-c602-49bd-9e25-1d94b462a9e4 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:47.366665 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-f48e3033-c602-49bd-9e25-1d94b462a9e4 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:47.375370 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-f48e3033-c602-49bd-9e25-1d94b462a9e4 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1322 microversion: 2.1 time: 0.165141 Aug 27 04:32:47.376088 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 128/262] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:32:47 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:47.537394 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-43264b92-89b4-4e1a-89bb-04a0259aa545 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54606e59672042dcbd37209fce5267fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7de2692ad114448ab4ce22c9e152f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:47.544734 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-43264b92-89b4-4e1a-89bb-04a0259aa545 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] 10.222.0.53 "GET /compute/v2.1/servers/a2ceae33-b8b9-4fe9-b507-4edb7d4a5403" status: 200 len: 1315 microversion: 2.1 time: 0.389558 Aug 27 04:32:47.545411 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 135/263] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:32:47 2021] GET /compute/v2.1/servers/a2ceae33-b8b9-4fe9-b507-4edb7d4a5403 => generated 1315 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:48.164834 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-53f43d09-4e55-448c-9a09-8f206774ac5f tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:48.165750 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-53f43d09-4e55-448c-9a09-8f206774ac5f tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:48.171681 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-53f43d09-4e55-448c-9a09-8f206774ac5f tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:48.172192 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-53f43d09-4e55-448c-9a09-8f206774ac5f tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:48.172983 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-53f43d09-4e55-448c-9a09-8f206774ac5f tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:48.173426 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-53f43d09-4e55-448c-9a09-8f206774ac5f tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:48.220525 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-de88b46d-2c41-49fd-a9e4-dc20d84d56ce tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:48.221252 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-de88b46d-2c41-49fd-a9e4-dc20d84d56ce tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:48.230603 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-de88b46d-2c41-49fd-a9e4-dc20d84d56ce tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:48.231061 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-de88b46d-2c41-49fd-a9e4-dc20d84d56ce tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:48.231856 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-de88b46d-2c41-49fd-a9e4-dc20d84d56ce tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:48.232341 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-de88b46d-2c41-49fd-a9e4-dc20d84d56ce tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:48.909217 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-53f43d09-4e55-448c-9a09-8f206774ac5f tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28642 microversion: 2.1 time: 0.747815 Aug 27 04:32:48.909859 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 129/264] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:32:48 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28642 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:32:48.915170 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-dd23697a-ab86-4aad-9d5e-bb121e56f83f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:48.915868 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-dd23697a-ab86-4aad-9d5e-bb121e56f83f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:48.924516 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-dd23697a-ab86-4aad-9d5e-bb121e56f83f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:48.924971 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-dd23697a-ab86-4aad-9d5e-bb121e56f83f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:48.925797 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-dd23697a-ab86-4aad-9d5e-bb121e56f83f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:48.926243 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-dd23697a-ab86-4aad-9d5e-bb121e56f83f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:48.930434 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-de88b46d-2c41-49fd-a9e4-dc20d84d56ce tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28417 microversion: 2.20 time: 0.713933 Aug 27 04:32:48.931080 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 136/265] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:32:48 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28417 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:32:48.936496 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-48a9414e-ac82-4ce9-9ecf-97fc4a48c1b2 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:48.937197 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-48a9414e-ac82-4ce9-9ecf-97fc4a48c1b2 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] [instance: a2ceae33-b8b9-4fe9-b507-4edb7d4a5403] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:48.946723 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-48a9414e-ac82-4ce9-9ecf-97fc4a48c1b2 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:48.947165 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-48a9414e-ac82-4ce9-9ecf-97fc4a48c1b2 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:48.947938 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-48a9414e-ac82-4ce9-9ecf-97fc4a48c1b2 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:48.948402 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-48a9414e-ac82-4ce9-9ecf-97fc4a48c1b2 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:49.066579 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-dd23697a-ab86-4aad-9d5e-bb121e56f83f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:49.074111 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-dd23697a-ab86-4aad-9d5e-bb121e56f83f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1322 microversion: 2.1 time: 0.163083 Aug 27 04:32:49.074778 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 130/266] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:32:48 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:49.089709 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-48a9414e-ac82-4ce9-9ecf-97fc4a48c1b2 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54606e59672042dcbd37209fce5267fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7de2692ad114448ab4ce22c9e152f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:49.097599 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-48a9414e-ac82-4ce9-9ecf-97fc4a48c1b2 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] 10.222.0.53 "GET /compute/v2.1/servers/a2ceae33-b8b9-4fe9-b507-4edb7d4a5403" status: 200 len: 1315 microversion: 2.1 time: 0.164906 Aug 27 04:32:49.098193 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 137/267] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:32:48 2021] GET /compute/v2.1/servers/a2ceae33-b8b9-4fe9-b507-4edb7d4a5403 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:49.923510 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-933deaac-e592-44aa-a1d3-1bf33b938856 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:49.923510 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-933deaac-e592-44aa-a1d3-1bf33b938856 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:49.929146 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-933deaac-e592-44aa-a1d3-1bf33b938856 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:49.929557 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-933deaac-e592-44aa-a1d3-1bf33b938856 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:49.930332 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-933deaac-e592-44aa-a1d3-1bf33b938856 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:49.930768 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-933deaac-e592-44aa-a1d3-1bf33b938856 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:49.942269 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-eb00f66d-22f3-43b0-8a3e-a359569b4b00 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:49.943174 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-eb00f66d-22f3-43b0-8a3e-a359569b4b00 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:49.949692 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-eb00f66d-22f3-43b0-8a3e-a359569b4b00 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:49.950130 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-eb00f66d-22f3-43b0-8a3e-a359569b4b00 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:49.950890 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-eb00f66d-22f3-43b0-8a3e-a359569b4b00 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:49.951320 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-eb00f66d-22f3-43b0-8a3e-a359569b4b00 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:50.121444 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-eb00f66d-22f3-43b0-8a3e-a359569b4b00 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28417 microversion: 2.20 time: 0.182687 Aug 27 04:32:50.125185 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 138/268] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:32:49 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28417 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:32:50.127213 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-aa9a2254-c24e-4d40-b8a6-d6674055172a tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:50.127889 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-aa9a2254-c24e-4d40-b8a6-d6674055172a tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:50.134890 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-aa9a2254-c24e-4d40-b8a6-d6674055172a tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:50.135327 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-aa9a2254-c24e-4d40-b8a6-d6674055172a tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:50.136111 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-aa9a2254-c24e-4d40-b8a6-d6674055172a tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:50.136539 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-aa9a2254-c24e-4d40-b8a6-d6674055172a tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:50.168401 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-933deaac-e592-44aa-a1d3-1bf33b938856 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28642 microversion: 2.1 time: 0.250284 Aug 27 04:32:50.169287 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 131/269] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:32:49 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28642 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:32:50.173946 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-bee5595f-549d-4051-8576-7ec73d87f45c tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:50.174668 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-bee5595f-549d-4051-8576-7ec73d87f45c tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] [instance: a2ceae33-b8b9-4fe9-b507-4edb7d4a5403] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:50.181475 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-bee5595f-549d-4051-8576-7ec73d87f45c tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:50.181835 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-bee5595f-549d-4051-8576-7ec73d87f45c tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:50.182611 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-bee5595f-549d-4051-8576-7ec73d87f45c tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:50.183041 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-bee5595f-549d-4051-8576-7ec73d87f45c tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:50.267783 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-aa9a2254-c24e-4d40-b8a6-d6674055172a tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:50.276211 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-aa9a2254-c24e-4d40-b8a6-d6674055172a tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1322 microversion: 2.1 time: 0.152713 Aug 27 04:32:50.276786 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 139/270] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:32:50 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:50.323773 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-bee5595f-549d-4051-8576-7ec73d87f45c tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54606e59672042dcbd37209fce5267fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7de2692ad114448ab4ce22c9e152f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:50.331214 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-bee5595f-549d-4051-8576-7ec73d87f45c tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] 10.222.0.53 "GET /compute/v2.1/servers/a2ceae33-b8b9-4fe9-b507-4edb7d4a5403" status: 200 len: 1315 microversion: 2.1 time: 0.160993 Aug 27 04:32:50.331782 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 132/271] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:32:50 2021] GET /compute/v2.1/servers/a2ceae33-b8b9-4fe9-b507-4edb7d4a5403 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:51.132131 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-142801aa-688d-4df3-b45d-271f17d1d436 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:51.132965 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-142801aa-688d-4df3-b45d-271f17d1d436 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:51.139386 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-142801aa-688d-4df3-b45d-271f17d1d436 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:51.139834 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-142801aa-688d-4df3-b45d-271f17d1d436 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:51.140637 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-142801aa-688d-4df3-b45d-271f17d1d436 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:51.141073 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-142801aa-688d-4df3-b45d-271f17d1d436 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:51.180697 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-b61230dd-1015-4c9e-ab2f-799733696478 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:51.181530 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-b61230dd-1015-4c9e-ab2f-799733696478 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:51.187871 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b61230dd-1015-4c9e-ab2f-799733696478 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:51.188352 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b61230dd-1015-4c9e-ab2f-799733696478 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:51.189132 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b61230dd-1015-4c9e-ab2f-799733696478 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:51.189571 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b61230dd-1015-4c9e-ab2f-799733696478 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:51.351901 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-b61230dd-1015-4c9e-ab2f-799733696478 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28642 microversion: 2.1 time: 0.175461 Aug 27 04:32:51.356210 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 133/272] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:32:51 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28642 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:32:51.357514 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-db75a0f2-2ad2-4e97-8254-cce3eff0dbc5 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:51.358206 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-db75a0f2-2ad2-4e97-8254-cce3eff0dbc5 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:51.364937 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-db75a0f2-2ad2-4e97-8254-cce3eff0dbc5 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:51.365386 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-db75a0f2-2ad2-4e97-8254-cce3eff0dbc5 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:51.366173 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-db75a0f2-2ad2-4e97-8254-cce3eff0dbc5 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:51.366607 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-db75a0f2-2ad2-4e97-8254-cce3eff0dbc5 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:51.385954 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-142801aa-688d-4df3-b45d-271f17d1d436 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28584 microversion: 2.20 time: 0.257324 Aug 27 04:32:51.386638 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 140/273] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:32:51 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28584 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:32:51.391673 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-91c49078-9b3d-4805-b7b4-8404e0b91372 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:51.392393 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-91c49078-9b3d-4805-b7b4-8404e0b91372 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] [instance: a2ceae33-b8b9-4fe9-b507-4edb7d4a5403] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:51.399566 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-91c49078-9b3d-4805-b7b4-8404e0b91372 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:51.400037 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-91c49078-9b3d-4805-b7b4-8404e0b91372 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:51.400819 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-91c49078-9b3d-4805-b7b4-8404e0b91372 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:51.401254 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-91c49078-9b3d-4805-b7b4-8404e0b91372 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:51.498809 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-db75a0f2-2ad2-4e97-8254-cce3eff0dbc5 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:51.508346 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-db75a0f2-2ad2-4e97-8254-cce3eff0dbc5 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1322 microversion: 2.1 time: 0.154495 Aug 27 04:32:51.509339 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 134/274] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:32:51 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:51.538854 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-91c49078-9b3d-4805-b7b4-8404e0b91372 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54606e59672042dcbd37209fce5267fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7de2692ad114448ab4ce22c9e152f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:51.546325 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-91c49078-9b3d-4805-b7b4-8404e0b91372 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] 10.222.0.53 "GET /compute/v2.1/servers/a2ceae33-b8b9-4fe9-b507-4edb7d4a5403" status: 200 len: 1315 microversion: 2.1 time: 0.158535 Aug 27 04:32:51.546899 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 141/275] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:32:51 2021] GET /compute/v2.1/servers/a2ceae33-b8b9-4fe9-b507-4edb7d4a5403 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:52.362732 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-f98e5ead-c3b6-4beb-a015-2303fbc42491 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:52.363756 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-f98e5ead-c3b6-4beb-a015-2303fbc42491 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:52.370531 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f98e5ead-c3b6-4beb-a015-2303fbc42491 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:52.370983 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f98e5ead-c3b6-4beb-a015-2303fbc42491 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:52.371760 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f98e5ead-c3b6-4beb-a015-2303fbc42491 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:52.372226 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f98e5ead-c3b6-4beb-a015-2303fbc42491 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:52.398987 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-57ab20f1-37fa-47a4-94db-38374227a90c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:52.400274 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-57ab20f1-37fa-47a4-94db-38374227a90c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:52.406648 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-57ab20f1-37fa-47a4-94db-38374227a90c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:52.407085 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-57ab20f1-37fa-47a4-94db-38374227a90c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:52.407850 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-57ab20f1-37fa-47a4-94db-38374227a90c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:52.408294 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-57ab20f1-37fa-47a4-94db-38374227a90c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:52.495616 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-f98e5ead-c3b6-4beb-a015-2303fbc42491 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28642 microversion: 2.1 time: 0.136384 Aug 27 04:32:52.496209 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 135/276] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:32:52 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28642 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:32:52.527011 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-32e982c5-4919-4707-aeb0-d8c3b421dc3e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:52.527244 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-57ab20f1-37fa-47a4-94db-38374227a90c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28584 microversion: 2.20 time: 0.132237 Aug 27 04:32:52.527650 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 142/277] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:32:52 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28584 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:32:52.527781 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-32e982c5-4919-4707-aeb0-d8c3b421dc3e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:52.534338 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-32e982c5-4919-4707-aeb0-d8c3b421dc3e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:52.534782 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-32e982c5-4919-4707-aeb0-d8c3b421dc3e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:52.535548 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-32e982c5-4919-4707-aeb0-d8c3b421dc3e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:52.535981 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-32e982c5-4919-4707-aeb0-d8c3b421dc3e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:52.562712 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-f97cdfaa-f2a9-4e87-89be-f2960bfd8191 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:52.563417 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-f97cdfaa-f2a9-4e87-89be-f2960bfd8191 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] [instance: a2ceae33-b8b9-4fe9-b507-4edb7d4a5403] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:52.570662 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f97cdfaa-f2a9-4e87-89be-f2960bfd8191 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:52.571104 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f97cdfaa-f2a9-4e87-89be-f2960bfd8191 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:52.571891 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f97cdfaa-f2a9-4e87-89be-f2960bfd8191 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:52.572351 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f97cdfaa-f2a9-4e87-89be-f2960bfd8191 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:52.666474 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-32e982c5-4919-4707-aeb0-d8c3b421dc3e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:52.676119 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-32e982c5-4919-4707-aeb0-d8c3b421dc3e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1322 microversion: 2.1 time: 0.153201 Aug 27 04:32:52.677077 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 136/278] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:32:52 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:32:52.712997 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-f97cdfaa-f2a9-4e87-89be-f2960bfd8191 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54606e59672042dcbd37209fce5267fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7de2692ad114448ab4ce22c9e152f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:52.721624 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-f97cdfaa-f2a9-4e87-89be-f2960bfd8191 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] 10.222.0.53 "GET /compute/v2.1/servers/a2ceae33-b8b9-4fe9-b507-4edb7d4a5403" status: 200 len: 1315 microversion: 2.1 time: 0.162840 Aug 27 04:32:52.722361 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 143/279] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:32:52 2021] GET /compute/v2.1/servers/a2ceae33-b8b9-4fe9-b507-4edb7d4a5403 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:32:53.507729 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-285695e6-db4b-428e-a070-3de21e0f2642 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:53.508662 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-285695e6-db4b-428e-a070-3de21e0f2642 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:53.514651 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-285695e6-db4b-428e-a070-3de21e0f2642 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:53.515094 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-285695e6-db4b-428e-a070-3de21e0f2642 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:53.515857 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-285695e6-db4b-428e-a070-3de21e0f2642 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:53.516318 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-285695e6-db4b-428e-a070-3de21e0f2642 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:53.538697 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-b74dd8ca-f879-4e44-831f-3467fe2c9338 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:53.539606 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-b74dd8ca-f879-4e44-831f-3467fe2c9338 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:53.545588 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b74dd8ca-f879-4e44-831f-3467fe2c9338 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:53.546068 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b74dd8ca-f879-4e44-831f-3467fe2c9338 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:53.546872 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b74dd8ca-f879-4e44-831f-3467fe2c9338 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:53.547328 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b74dd8ca-f879-4e44-831f-3467fe2c9338 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:53.745060 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-b74dd8ca-f879-4e44-831f-3467fe2c9338 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28584 microversion: 2.20 time: 0.209826 Aug 27 04:32:53.749031 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 144/280] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:32:53 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28584 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:32:53.750651 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-960ba4d0-12c4-49f5-a73c-84b0723c2875 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:53.751355 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-960ba4d0-12c4-49f5-a73c-84b0723c2875 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:53.758509 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-960ba4d0-12c4-49f5-a73c-84b0723c2875 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:53.758946 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-960ba4d0-12c4-49f5-a73c-84b0723c2875 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:53.759710 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-960ba4d0-12c4-49f5-a73c-84b0723c2875 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:53.760166 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-960ba4d0-12c4-49f5-a73c-84b0723c2875 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:53.781149 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-285695e6-db4b-428e-a070-3de21e0f2642 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28642 microversion: 2.1 time: 0.277907 Aug 27 04:32:53.781792 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 137/281] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:32:53 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28642 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:32:53.786996 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-84da1b5b-2b82-4dea-aaca-a1ef965a2122 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:53.787722 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-84da1b5b-2b82-4dea-aaca-a1ef965a2122 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] [instance: a2ceae33-b8b9-4fe9-b507-4edb7d4a5403] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:53.794311 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-84da1b5b-2b82-4dea-aaca-a1ef965a2122 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:53.794755 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-84da1b5b-2b82-4dea-aaca-a1ef965a2122 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:53.795525 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-84da1b5b-2b82-4dea-aaca-a1ef965a2122 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:53.795954 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-84da1b5b-2b82-4dea-aaca-a1ef965a2122 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:53.889462 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-960ba4d0-12c4-49f5-a73c-84b0723c2875 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:53.897005 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-960ba4d0-12c4-49f5-a73c-84b0723c2875 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1322 microversion: 2.1 time: 0.150003 Aug 27 04:32:53.897587 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 145/282] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:32:53 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:53.921630 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-84da1b5b-2b82-4dea-aaca-a1ef965a2122 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54606e59672042dcbd37209fce5267fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7de2692ad114448ab4ce22c9e152f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:53.929744 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-84da1b5b-2b82-4dea-aaca-a1ef965a2122 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] 10.222.0.53 "GET /compute/v2.1/servers/a2ceae33-b8b9-4fe9-b507-4edb7d4a5403" status: 200 len: 1315 microversion: 2.1 time: 0.146513 Aug 27 04:32:53.930250 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 138/283] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:32:53 2021] GET /compute/v2.1/servers/a2ceae33-b8b9-4fe9-b507-4edb7d4a5403 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:54.757197 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-9536329e-0b93-4416-b67f-c43bf1c3afc9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:54.758131 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-9536329e-0b93-4416-b67f-c43bf1c3afc9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:54.764432 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9536329e-0b93-4416-b67f-c43bf1c3afc9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:54.764881 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9536329e-0b93-4416-b67f-c43bf1c3afc9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:54.765645 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9536329e-0b93-4416-b67f-c43bf1c3afc9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:54.766080 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9536329e-0b93-4416-b67f-c43bf1c3afc9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:54.793241 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-92769a3e-5f14-48de-a930-614bef054cef tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:54.794383 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-92769a3e-5f14-48de-a930-614bef054cef tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:54.800817 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-92769a3e-5f14-48de-a930-614bef054cef tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:54.801375 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-92769a3e-5f14-48de-a930-614bef054cef tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:54.802347 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-92769a3e-5f14-48de-a930-614bef054cef tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:54.803013 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-92769a3e-5f14-48de-a930-614bef054cef tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:55.056464 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-9536329e-0b93-4416-b67f-c43bf1c3afc9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28584 microversion: 2.20 time: 0.303248 Aug 27 04:32:55.058084 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 146/284] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:32:54 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28584 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:32:55.062304 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-1398e84d-3519-437d-bb54-8c12a529c806 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:55.062994 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-1398e84d-3519-437d-bb54-8c12a529c806 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:55.070202 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1398e84d-3519-437d-bb54-8c12a529c806 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:55.070643 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1398e84d-3519-437d-bb54-8c12a529c806 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:55.071415 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1398e84d-3519-437d-bb54-8c12a529c806 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:55.071844 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1398e84d-3519-437d-bb54-8c12a529c806 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:55.074061 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-92769a3e-5f14-48de-a930-614bef054cef tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28642 microversion: 2.1 time: 0.284549 Aug 27 04:32:55.078631 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 139/285] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:32:54 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28642 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:32:55.080080 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-fe0cc6ff-5f0b-480f-82c2-5152abb14938 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:55.080798 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-fe0cc6ff-5f0b-480f-82c2-5152abb14938 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] [instance: a2ceae33-b8b9-4fe9-b507-4edb7d4a5403] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:55.088148 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fe0cc6ff-5f0b-480f-82c2-5152abb14938 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:55.088607 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fe0cc6ff-5f0b-480f-82c2-5152abb14938 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:55.089526 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fe0cc6ff-5f0b-480f-82c2-5152abb14938 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:55.089824 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fe0cc6ff-5f0b-480f-82c2-5152abb14938 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:55.210400 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-1398e84d-3519-437d-bb54-8c12a529c806 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:55.218460 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-1398e84d-3519-437d-bb54-8c12a529c806 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1322 microversion: 2.1 time: 0.160071 Aug 27 04:32:55.219045 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 147/286] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:32:55 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:55.220733 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-fe0cc6ff-5f0b-480f-82c2-5152abb14938 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54606e59672042dcbd37209fce5267fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7de2692ad114448ab4ce22c9e152f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:55.230568 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-fe0cc6ff-5f0b-480f-82c2-5152abb14938 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] 10.222.0.53 "GET /compute/v2.1/servers/a2ceae33-b8b9-4fe9-b507-4edb7d4a5403" status: 200 len: 1315 microversion: 2.1 time: 0.154391 Aug 27 04:32:55.231137 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 140/287] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:32:55 2021] GET /compute/v2.1/servers/a2ceae33-b8b9-4fe9-b507-4edb7d4a5403 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:56.068799 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-659a8174-c279-40ab-901d-f2c576c6403a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:56.069707 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-659a8174-c279-40ab-901d-f2c576c6403a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:56.076225 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-659a8174-c279-40ab-901d-f2c576c6403a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:56.076672 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-659a8174-c279-40ab-901d-f2c576c6403a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:56.077442 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-659a8174-c279-40ab-901d-f2c576c6403a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:56.077878 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-659a8174-c279-40ab-901d-f2c576c6403a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:56.086829 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-554003f9-9af1-438d-95ea-16e0e94dcc5e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:56.087760 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-554003f9-9af1-438d-95ea-16e0e94dcc5e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:56.094206 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-554003f9-9af1-438d-95ea-16e0e94dcc5e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:56.094659 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-554003f9-9af1-438d-95ea-16e0e94dcc5e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:56.095586 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-554003f9-9af1-438d-95ea-16e0e94dcc5e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:56.096312 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-554003f9-9af1-438d-95ea-16e0e94dcc5e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:56.390241 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-659a8174-c279-40ab-901d-f2c576c6403a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28584 microversion: 2.20 time: 0.325523 Aug 27 04:32:56.390891 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 148/288] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:32:56 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28584 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:32:56.396482 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-e706e7a7-d8cc-481b-91dd-98869ae1b32b tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:56.397260 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-e706e7a7-d8cc-481b-91dd-98869ae1b32b tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:56.403959 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e706e7a7-d8cc-481b-91dd-98869ae1b32b tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:56.404444 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e706e7a7-d8cc-481b-91dd-98869ae1b32b tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:56.405224 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e706e7a7-d8cc-481b-91dd-98869ae1b32b tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:56.405659 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e706e7a7-d8cc-481b-91dd-98869ae1b32b tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:56.413564 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-554003f9-9af1-438d-95ea-16e0e94dcc5e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28642 microversion: 2.1 time: 0.330456 Aug 27 04:32:56.417454 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 141/289] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:32:56 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28642 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:32:56.421516 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-7148355b-60a0-4548-84c7-87ba0608ec88 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:56.422378 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-7148355b-60a0-4548-84c7-87ba0608ec88 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] [instance: a2ceae33-b8b9-4fe9-b507-4edb7d4a5403] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:56.428503 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7148355b-60a0-4548-84c7-87ba0608ec88 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:56.429065 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7148355b-60a0-4548-84c7-87ba0608ec88 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:56.430021 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7148355b-60a0-4548-84c7-87ba0608ec88 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:56.430460 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7148355b-60a0-4548-84c7-87ba0608ec88 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:56.536259 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-e706e7a7-d8cc-481b-91dd-98869ae1b32b tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:56.543906 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-e706e7a7-d8cc-481b-91dd-98869ae1b32b tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1322 microversion: 2.1 time: 0.151553 Aug 27 04:32:56.544423 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 149/290] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:32:56 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:56.574471 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-7148355b-60a0-4548-84c7-87ba0608ec88 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54606e59672042dcbd37209fce5267fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7de2692ad114448ab4ce22c9e152f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:56.582253 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-7148355b-60a0-4548-84c7-87ba0608ec88 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] 10.222.0.53 "GET /compute/v2.1/servers/a2ceae33-b8b9-4fe9-b507-4edb7d4a5403" status: 200 len: 1315 microversion: 2.1 time: 0.165588 Aug 27 04:32:56.582822 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 142/291] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:32:56 2021] GET /compute/v2.1/servers/a2ceae33-b8b9-4fe9-b507-4edb7d4a5403 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:56.837304 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [req-40421574-98dc-448d-b344-f0c4a3a799a1 req-d7fb2934-7731-40fe-b987-f8c7045add99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df8098ad-7c9c-4ba5-992d-392f9cd1742a", "name": "network-vif-plugged", "status": "completed", "tag": "c3463dab-7cf3-45d8-9707-77a461c168a9"}]} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:56.839893 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:32:56.839893 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: warnings.warn(msg) Aug 27 04:32:56.846302 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-40421574-98dc-448d-b344-f0c4a3a799a1 req-d7fb2934-7731-40fe-b987-f8c7045add99 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:56.846742 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-40421574-98dc-448d-b344-f0c4a3a799a1 req-d7fb2934-7731-40fe-b987-f8c7045add99 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:56.858118 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.compute.server_external_events [req-40421574-98dc-448d-b344-f0c4a3a799a1 req-d7fb2934-7731-40fe-b987-f8c7045add99 service nova] Creating event network-vif-plugged:c3463dab-7cf3-45d8-9707-77a461c168a9 for instance df8098ad-7c9c-4ba5-992d-392f9cd1742a on hv-cinder-80403 Aug 27 04:32:56.862912 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [req-40421574-98dc-448d-b344-f0c4a3a799a1 req-d7fb2934-7731-40fe-b987-f8c7045add99 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029738 Aug 27 04:32:56.863677 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 150/292] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:32:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:57.404997 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-213cc210-9c2b-4630-b029-b21bb08ba0d3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:57.405917 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-213cc210-9c2b-4630-b029-b21bb08ba0d3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:57.411957 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-213cc210-9c2b-4630-b029-b21bb08ba0d3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:57.412594 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-213cc210-9c2b-4630-b029-b21bb08ba0d3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:57.413378 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-213cc210-9c2b-4630-b029-b21bb08ba0d3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:57.413816 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-213cc210-9c2b-4630-b029-b21bb08ba0d3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:57.426305 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-a964b4e1-2bd4-4353-b160-fb3c4516f5ea tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:57.427812 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-a964b4e1-2bd4-4353-b160-fb3c4516f5ea tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:57.434684 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a964b4e1-2bd4-4353-b160-fb3c4516f5ea tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:57.435121 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a964b4e1-2bd4-4353-b160-fb3c4516f5ea tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:57.435902 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a964b4e1-2bd4-4353-b160-fb3c4516f5ea tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:57.436367 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a964b4e1-2bd4-4353-b160-fb3c4516f5ea tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:58.027767 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-a964b4e1-2bd4-4353-b160-fb3c4516f5ea tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28642 microversion: 2.1 time: 0.605891 Aug 27 04:32:58.028442 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 151/293] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:32:57 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28642 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:32:58.033915 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-28f10bae-1200-46d2-b096-f73e1830a534 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:58.034618 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-28f10bae-1200-46d2-b096-f73e1830a534 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:58.041806 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-28f10bae-1200-46d2-b096-f73e1830a534 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:58.042263 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-28f10bae-1200-46d2-b096-f73e1830a534 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:58.043041 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-28f10bae-1200-46d2-b096-f73e1830a534 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:58.043480 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-28f10bae-1200-46d2-b096-f73e1830a534 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:58.092122 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-213cc210-9c2b-4630-b029-b21bb08ba0d3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28584 microversion: 2.20 time: 0.690697 Aug 27 04:32:58.092776 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 143/294] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:32:57 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28584 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:32:58.097996 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-6e469b79-fb3b-4b5c-b058-33dd95c0ab4a tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:58.099330 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-6e469b79-fb3b-4b5c-b058-33dd95c0ab4a tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] [instance: a2ceae33-b8b9-4fe9-b507-4edb7d4a5403] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:58.106397 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6e469b79-fb3b-4b5c-b058-33dd95c0ab4a tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:58.106921 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6e469b79-fb3b-4b5c-b058-33dd95c0ab4a tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:58.107711 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6e469b79-fb3b-4b5c-b058-33dd95c0ab4a tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:58.108203 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6e469b79-fb3b-4b5c-b058-33dd95c0ab4a tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:58.188927 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-28f10bae-1200-46d2-b096-f73e1830a534 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:58.198599 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-28f10bae-1200-46d2-b096-f73e1830a534 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1322 microversion: 2.1 time: 0.168553 Aug 27 04:32:58.199452 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 152/295] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:32:58 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:58.238420 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-6e469b79-fb3b-4b5c-b058-33dd95c0ab4a tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54606e59672042dcbd37209fce5267fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7de2692ad114448ab4ce22c9e152f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:58.248431 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-6e469b79-fb3b-4b5c-b058-33dd95c0ab4a tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] 10.222.0.53 "GET /compute/v2.1/servers/a2ceae33-b8b9-4fe9-b507-4edb7d4a5403" status: 200 len: 1315 microversion: 2.1 time: 0.154286 Aug 27 04:32:58.249089 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 144/296] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:32:58 2021] GET /compute/v2.1/servers/a2ceae33-b8b9-4fe9-b507-4edb7d4a5403 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:58.988809 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [req-f1a73499-e1a8-46c1-af96-949d63811fa1 req-4de96fb6-0bd1-4a57-a4ce-90f48520ace1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e594817-f3cc-40e6-babe-c736641fb9a9", "name": "network-vif-plugged", "status": "completed", "tag": "8d848bd3-1806-43f5-a0cc-2ccc980f7264"}]} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:58.990563 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:32:58.990563 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: warnings.warn(msg) Aug 27 04:32:58.997903 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-f1a73499-e1a8-46c1-af96-949d63811fa1 req-4de96fb6-0bd1-4a57-a4ce-90f48520ace1 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:58.998345 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-f1a73499-e1a8-46c1-af96-949d63811fa1 req-4de96fb6-0bd1-4a57-a4ce-90f48520ace1 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:59.010491 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.compute.server_external_events [req-f1a73499-e1a8-46c1-af96-949d63811fa1 req-4de96fb6-0bd1-4a57-a4ce-90f48520ace1 service nova] Creating event network-vif-plugged:8d848bd3-1806-43f5-a0cc-2ccc980f7264 for instance 0e594817-f3cc-40e6-babe-c736641fb9a9 on hv-cinder-80403 Aug 27 04:32:59.015374 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [req-f1a73499-e1a8-46c1-af96-949d63811fa1 req-4de96fb6-0bd1-4a57-a4ce-90f48520ace1 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030068 Aug 27 04:32:59.016007 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 153/297] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:32:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:32:59.039562 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-6d47a459-0898-4818-b43b-f2c44965c7e2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:59.040596 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-6d47a459-0898-4818-b43b-f2c44965c7e2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:59.047087 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6d47a459-0898-4818-b43b-f2c44965c7e2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:59.047557 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6d47a459-0898-4818-b43b-f2c44965c7e2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:59.048416 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6d47a459-0898-4818-b43b-f2c44965c7e2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:59.048883 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6d47a459-0898-4818-b43b-f2c44965c7e2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:59.106008 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-cacc5e98-043a-45a7-bccd-09555fc2650e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:32:59.107019 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-cacc5e98-043a-45a7-bccd-09555fc2650e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:59.113769 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cacc5e98-043a-45a7-bccd-09555fc2650e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:59.114068 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cacc5e98-043a-45a7-bccd-09555fc2650e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:59.114835 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cacc5e98-043a-45a7-bccd-09555fc2650e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:59.115400 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cacc5e98-043a-45a7-bccd-09555fc2650e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:59.245670 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-6d47a459-0898-4818-b43b-f2c44965c7e2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28642 microversion: 2.1 time: 0.210439 Aug 27 04:32:59.246316 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 145/298] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:32:59 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28642 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:32:59.251328 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-a1659ee9-c895-4a74-a793-e9857966549e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:59.252053 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-a1659ee9-c895-4a74-a793-e9857966549e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:59.260963 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a1659ee9-c895-4a74-a793-e9857966549e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:59.261563 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a1659ee9-c895-4a74-a793-e9857966549e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:59.262317 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a1659ee9-c895-4a74-a793-e9857966549e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:59.262769 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a1659ee9-c895-4a74-a793-e9857966549e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:59.282891 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-cacc5e98-043a-45a7-bccd-09555fc2650e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28584 microversion: 2.20 time: 0.181453 Aug 27 04:32:59.283838 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 154/299] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:32:59 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28584 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:32:59.289494 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-fed62c26-1352-4895-83c8-3ecae26aad06 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:32:59.290387 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-fed62c26-1352-4895-83c8-3ecae26aad06 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] [instance: a2ceae33-b8b9-4fe9-b507-4edb7d4a5403] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:32:59.297843 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-fed62c26-1352-4895-83c8-3ecae26aad06 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:59.298525 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-fed62c26-1352-4895-83c8-3ecae26aad06 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:59.299510 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-fed62c26-1352-4895-83c8-3ecae26aad06 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:32:59.300128 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-fed62c26-1352-4895-83c8-3ecae26aad06 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:32:59.451899 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-a1659ee9-c895-4a74-a793-e9857966549e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:59.460205 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-a1659ee9-c895-4a74-a793-e9857966549e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1322 microversion: 2.1 time: 0.212641 Aug 27 04:32:59.460783 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 146/300] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:32:59 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:32:59.590188 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-fed62c26-1352-4895-83c8-3ecae26aad06 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54606e59672042dcbd37209fce5267fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7de2692ad114448ab4ce22c9e152f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:32:59.597661 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-fed62c26-1352-4895-83c8-3ecae26aad06 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] 10.222.0.53 "GET /compute/v2.1/servers/a2ceae33-b8b9-4fe9-b507-4edb7d4a5403" status: 200 len: 1315 microversion: 2.1 time: 0.312474 Aug 27 04:32:59.598205 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 155/301] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:32:59 2021] GET /compute/v2.1/servers/a2ceae33-b8b9-4fe9-b507-4edb7d4a5403 => generated 1315 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:00.258723 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-fca2c540-1b05-4980-aaba-cd104f8cfa04 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:00.259627 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-fca2c540-1b05-4980-aaba-cd104f8cfa04 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:00.266035 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fca2c540-1b05-4980-aaba-cd104f8cfa04 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:00.266487 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fca2c540-1b05-4980-aaba-cd104f8cfa04 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:00.267266 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fca2c540-1b05-4980-aaba-cd104f8cfa04 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:00.267707 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fca2c540-1b05-4980-aaba-cd104f8cfa04 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:00.297740 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-127c39f5-4db5-4c7a-a2bf-a51292442f90 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:00.298650 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-127c39f5-4db5-4c7a-a2bf-a51292442f90 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:00.305958 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-127c39f5-4db5-4c7a-a2bf-a51292442f90 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:00.306390 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-127c39f5-4db5-4c7a-a2bf-a51292442f90 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:00.307160 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-127c39f5-4db5-4c7a-a2bf-a51292442f90 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:00.307599 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-127c39f5-4db5-4c7a-a2bf-a51292442f90 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:00.406975 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-fca2c540-1b05-4980-aaba-cd104f8cfa04 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28642 microversion: 2.1 time: 0.152329 Aug 27 04:33:00.408397 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 147/302] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:33:00 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28642 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:33:00.451579 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-127c39f5-4db5-4c7a-a2bf-a51292442f90 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28584 microversion: 2.20 time: 0.158540 Aug 27 04:33:00.455443 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 156/303] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:33:00 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28584 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:33:00.477712 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-6c72496a-1b78-4c56-8c85-8e230e5c6e84 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:00.478426 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-6c72496a-1b78-4c56-8c85-8e230e5c6e84 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:00.484971 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6c72496a-1b78-4c56-8c85-8e230e5c6e84 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:00.485428 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6c72496a-1b78-4c56-8c85-8e230e5c6e84 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:00.486217 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6c72496a-1b78-4c56-8c85-8e230e5c6e84 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:00.486665 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6c72496a-1b78-4c56-8c85-8e230e5c6e84 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:00.613465 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-6c72496a-1b78-4c56-8c85-8e230e5c6e84 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:00.617217 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-998a4c6c-568b-4357-b145-b09ca88e75d7 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:00.619550 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-998a4c6c-568b-4357-b145-b09ca88e75d7 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] [instance: a2ceae33-b8b9-4fe9-b507-4edb7d4a5403] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:00.625013 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-6c72496a-1b78-4c56-8c85-8e230e5c6e84 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1516 microversion: 2.1 time: 0.151247 Aug 27 04:33:00.626329 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-998a4c6c-568b-4357-b145-b09ca88e75d7 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:00.627027 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-998a4c6c-568b-4357-b145-b09ca88e75d7 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:00.627948 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-998a4c6c-568b-4357-b145-b09ca88e75d7 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:00.628667 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-998a4c6c-568b-4357-b145-b09ca88e75d7 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:00.629219 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 148/304] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:33:00 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:00.643322 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-509b3c4c-c53a-49a9-92e1-05f71b46ca4a tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:00.644317 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-509b3c4c-c53a-49a9-92e1-05f71b46ca4a tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:00.653483 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-509b3c4c-c53a-49a9-92e1-05f71b46ca4a tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:00.654376 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-509b3c4c-c53a-49a9-92e1-05f71b46ca4a tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:00.655682 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-509b3c4c-c53a-49a9-92e1-05f71b46ca4a tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:00.656236 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-509b3c4c-c53a-49a9-92e1-05f71b46ca4a tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:00.681606 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.objects.instance [None req-509b3c4c-c53a-49a9-92e1-05f71b46ca4a tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lazy-loading 'flavor' on Instance uuid df8098ad-7c9c-4ba5-992d-392f9cd1742a {{(pid=108970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:33:00.777538 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-998a4c6c-568b-4357-b145-b09ca88e75d7 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54606e59672042dcbd37209fce5267fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7de2692ad114448ab4ce22c9e152f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:00.785743 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-998a4c6c-568b-4357-b145-b09ca88e75d7 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] 10.222.0.53 "GET /compute/v2.1/servers/a2ceae33-b8b9-4fe9-b507-4edb7d4a5403" status: 200 len: 1315 microversion: 2.1 time: 0.173940 Aug 27 04:33:00.786547 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 157/305] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:33:00 2021] GET /compute/v2.1/servers/a2ceae33-b8b9-4fe9-b507-4edb7d4a5403 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:33:00.804941 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-509b3c4c-c53a-49a9-92e1-05f71b46ca4a tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "POST /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a/action" status: 200 len: 32 microversion: 2.1 time: 0.165338 Aug 27 04:33:00.805534 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 149/306] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:33:00 2021] POST /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a/action => generated 32 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:33:00.814971 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-c70d6c45-95bb-49e7-931a-45b270b813a9 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:00.815939 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-c70d6c45-95bb-49e7-931a-45b270b813a9 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:00.822179 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c70d6c45-95bb-49e7-931a-45b270b813a9 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:00.822554 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c70d6c45-95bb-49e7-931a-45b270b813a9 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:00.823326 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c70d6c45-95bb-49e7-931a-45b270b813a9 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:00.823761 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c70d6c45-95bb-49e7-931a-45b270b813a9 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:01.033064 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-c70d6c45-95bb-49e7-931a-45b270b813a9 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:01.041641 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-c70d6c45-95bb-49e7-931a-45b270b813a9 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1522 microversion: 2.1 time: 0.230975 Aug 27 04:33:01.041885 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [req-d9275728-a766-4d63-bc59-945a56316884 req-99c800e9-2f95-4c75-a36f-afef36bee892 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2ceae33-b8b9-4fe9-b507-4edb7d4a5403", "name": "network-vif-plugged", "status": "completed", "tag": "ca061db2-994e-4835-9544-62ab84abf718"}]} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:01.042218 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 158/307] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:33:00 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:01.049303 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:33:01.049303 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: warnings.warn(msg) Aug 27 04:33:01.050732 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-d9275728-a766-4d63-bc59-945a56316884 req-99c800e9-2f95-4c75-a36f-afef36bee892 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:01.051406 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-d9275728-a766-4d63-bc59-945a56316884 req-99c800e9-2f95-4c75-a36f-afef36bee892 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:01.062819 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.compute.server_external_events [req-d9275728-a766-4d63-bc59-945a56316884 req-99c800e9-2f95-4c75-a36f-afef36bee892 service nova] Creating event network-vif-plugged:ca061db2-994e-4835-9544-62ab84abf718 for instance a2ceae33-b8b9-4fe9-b507-4edb7d4a5403 on hv-cinder-80403 Aug 27 04:33:01.067688 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [req-d9275728-a766-4d63-bc59-945a56316884 req-99c800e9-2f95-4c75-a36f-afef36bee892 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030487 Aug 27 04:33:01.068335 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 150/308] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:33:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:33:01.418800 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-99749f19-526d-4c0d-b394-8ece23653149 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:01.419708 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-99749f19-526d-4c0d-b394-8ece23653149 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:01.425665 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-99749f19-526d-4c0d-b394-8ece23653149 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:01.426049 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-99749f19-526d-4c0d-b394-8ece23653149 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:01.426816 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-99749f19-526d-4c0d-b394-8ece23653149 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:01.427253 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-99749f19-526d-4c0d-b394-8ece23653149 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:01.463840 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-b7d22b70-5737-4f42-95c1-e6c0759784e4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:01.464822 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-b7d22b70-5737-4f42-95c1-e6c0759784e4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:01.470920 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b7d22b70-5737-4f42-95c1-e6c0759784e4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:01.471369 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b7d22b70-5737-4f42-95c1-e6c0759784e4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:01.472178 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b7d22b70-5737-4f42-95c1-e6c0759784e4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:01.472623 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b7d22b70-5737-4f42-95c1-e6c0759784e4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:02.598027 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-b7d22b70-5737-4f42-95c1-e6c0759784e4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28584 microversion: 2.20 time: 1.138629 Aug 27 04:33:02.598720 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 151/309] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:33:01 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28584 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:33:02.603618 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-b1bd4a19-b6ca-4577-9938-74b43202c5a0 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:02.604334 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-b1bd4a19-b6ca-4577-9938-74b43202c5a0 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] [instance: a2ceae33-b8b9-4fe9-b507-4edb7d4a5403] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:02.610896 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b1bd4a19-b6ca-4577-9938-74b43202c5a0 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:02.611337 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b1bd4a19-b6ca-4577-9938-74b43202c5a0 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:02.612134 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b1bd4a19-b6ca-4577-9938-74b43202c5a0 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:02.612565 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b1bd4a19-b6ca-4577-9938-74b43202c5a0 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:02.677212 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-99749f19-526d-4c0d-b394-8ece23653149 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28642 microversion: 2.1 time: 1.261189 Aug 27 04:33:02.677212 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 159/310] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:33:01 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28642 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:33:02.682822 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-e91cd5e4-3082-4943-aaed-3b3ff868d607 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:02.683556 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-e91cd5e4-3082-4943-aaed-3b3ff868d607 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:02.690208 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e91cd5e4-3082-4943-aaed-3b3ff868d607 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:02.690654 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e91cd5e4-3082-4943-aaed-3b3ff868d607 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:02.691437 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e91cd5e4-3082-4943-aaed-3b3ff868d607 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:02.691873 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e91cd5e4-3082-4943-aaed-3b3ff868d607 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:02.759110 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-b1bd4a19-b6ca-4577-9938-74b43202c5a0 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54606e59672042dcbd37209fce5267fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7de2692ad114448ab4ce22c9e152f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:02.768942 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-b1bd4a19-b6ca-4577-9938-74b43202c5a0 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] 10.222.0.53 "GET /compute/v2.1/servers/a2ceae33-b8b9-4fe9-b507-4edb7d4a5403" status: 200 len: 1315 microversion: 2.1 time: 0.169004 Aug 27 04:33:02.769732 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 152/311] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:33:02 2021] GET /compute/v2.1/servers/a2ceae33-b8b9-4fe9-b507-4edb7d4a5403 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:02.831288 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-e91cd5e4-3082-4943-aaed-3b3ff868d607 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:02.839719 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-e91cd5e4-3082-4943-aaed-3b3ff868d607 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1522 microversion: 2.1 time: 0.160872 Aug 27 04:33:02.840369 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 160/312] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:33:02 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:03.619817 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-0d437da7-a141-4c22-8be2-c4f36a534baa tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:03.620768 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-0d437da7-a141-4c22-8be2-c4f36a534baa tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:03.627446 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0d437da7-a141-4c22-8be2-c4f36a534baa tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:03.627891 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0d437da7-a141-4c22-8be2-c4f36a534baa tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:03.628781 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0d437da7-a141-4c22-8be2-c4f36a534baa tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:03.629218 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0d437da7-a141-4c22-8be2-c4f36a534baa tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:03.695280 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-746aac83-c8be-4065-9a4e-7ac03b8735c1 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:03.696247 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-746aac83-c8be-4065-9a4e-7ac03b8735c1 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:03.703014 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-746aac83-c8be-4065-9a4e-7ac03b8735c1 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:03.703014 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-746aac83-c8be-4065-9a4e-7ac03b8735c1 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:03.703800 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-746aac83-c8be-4065-9a4e-7ac03b8735c1 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:03.704276 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-746aac83-c8be-4065-9a4e-7ac03b8735c1 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:03.738400 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-0d437da7-a141-4c22-8be2-c4f36a534baa tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28584 microversion: 2.20 time: 0.130681 Aug 27 04:33:03.739051 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 153/313] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:33:03 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28584 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:33:03.786632 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-8b5acc59-3e92-4633-acba-aeefe389922a tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:03.787468 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-8b5acc59-3e92-4633-acba-aeefe389922a tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] [instance: a2ceae33-b8b9-4fe9-b507-4edb7d4a5403] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:03.795137 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-8b5acc59-3e92-4633-acba-aeefe389922a tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:03.795962 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-8b5acc59-3e92-4633-acba-aeefe389922a tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:03.796864 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-8b5acc59-3e92-4633-acba-aeefe389922a tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:03.797372 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-8b5acc59-3e92-4633-acba-aeefe389922a tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:03.807573 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-746aac83-c8be-4065-9a4e-7ac03b8735c1 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28642 microversion: 2.1 time: 0.119488 Aug 27 04:33:03.812049 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 161/314] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:33:03 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28642 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:33:03.858363 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-70c0316c-0b58-4a48-955c-8c5dbd6922ae tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:03.859061 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-70c0316c-0b58-4a48-955c-8c5dbd6922ae tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:03.866162 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-70c0316c-0b58-4a48-955c-8c5dbd6922ae tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:03.866612 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-70c0316c-0b58-4a48-955c-8c5dbd6922ae tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:03.867450 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-70c0316c-0b58-4a48-955c-8c5dbd6922ae tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:03.867891 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-70c0316c-0b58-4a48-955c-8c5dbd6922ae tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:03.939747 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-8b5acc59-3e92-4633-acba-aeefe389922a tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54606e59672042dcbd37209fce5267fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7de2692ad114448ab4ce22c9e152f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:03.947580 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-8b5acc59-3e92-4633-acba-aeefe389922a tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] 10.222.0.53 "GET /compute/v2.1/servers/a2ceae33-b8b9-4fe9-b507-4edb7d4a5403" status: 200 len: 1315 microversion: 2.1 time: 0.165432 Aug 27 04:33:03.948739 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 154/315] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:33:03 2021] GET /compute/v2.1/servers/a2ceae33-b8b9-4fe9-b507-4edb7d4a5403 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:33:03.998224 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-70c0316c-0b58-4a48-955c-8c5dbd6922ae tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:04.005807 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-70c0316c-0b58-4a48-955c-8c5dbd6922ae tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1522 microversion: 2.1 time: 0.151354 Aug 27 04:33:04.006385 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 162/316] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:33:03 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:33:04.750017 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-5864609d-ffee-4751-a9c9-575d4e37532c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:04.750928 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-5864609d-ffee-4751-a9c9-575d4e37532c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:04.757031 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5864609d-ffee-4751-a9c9-575d4e37532c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:04.757484 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5864609d-ffee-4751-a9c9-575d4e37532c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:04.758257 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5864609d-ffee-4751-a9c9-575d4e37532c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:04.758696 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5864609d-ffee-4751-a9c9-575d4e37532c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:04.819218 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-6f674096-e04c-4563-a8f8-e8f900694b4c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:04.820166 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-6f674096-e04c-4563-a8f8-e8f900694b4c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:04.829898 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6f674096-e04c-4563-a8f8-e8f900694b4c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:04.830624 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6f674096-e04c-4563-a8f8-e8f900694b4c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:04.831436 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6f674096-e04c-4563-a8f8-e8f900694b4c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:04.831879 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6f674096-e04c-4563-a8f8-e8f900694b4c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:05.001257 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-5864609d-ffee-4751-a9c9-575d4e37532c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28584 microversion: 2.20 time: 0.254120 Aug 27 04:33:05.003102 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 155/317] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:33:04 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28584 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:33:05.008372 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-c5f4f148-99a1-4ff8-8f84-5f5fdb89266b tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:05.009079 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-c5f4f148-99a1-4ff8-8f84-5f5fdb89266b tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] [instance: a2ceae33-b8b9-4fe9-b507-4edb7d4a5403] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:05.016316 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-c5f4f148-99a1-4ff8-8f84-5f5fdb89266b tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:05.016768 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-c5f4f148-99a1-4ff8-8f84-5f5fdb89266b tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:05.017552 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-c5f4f148-99a1-4ff8-8f84-5f5fdb89266b tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:05.018163 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-c5f4f148-99a1-4ff8-8f84-5f5fdb89266b tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:05.042060 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-6f674096-e04c-4563-a8f8-e8f900694b4c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28642 microversion: 2.1 time: 0.225773 Aug 27 04:33:05.043511 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 163/318] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:33:04 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28642 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:33:05.049060 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-285ad00a-2a67-4167-9789-9732819e2d02 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:05.050625 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-285ad00a-2a67-4167-9789-9732819e2d02 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:05.057862 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-285ad00a-2a67-4167-9789-9732819e2d02 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:05.058840 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-285ad00a-2a67-4167-9789-9732819e2d02 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:05.059624 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-285ad00a-2a67-4167-9789-9732819e2d02 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:05.060076 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-285ad00a-2a67-4167-9789-9732819e2d02 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:05.172780 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-c5f4f148-99a1-4ff8-8f84-5f5fdb89266b tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54606e59672042dcbd37209fce5267fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7de2692ad114448ab4ce22c9e152f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:05.180550 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-c5f4f148-99a1-4ff8-8f84-5f5fdb89266b tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] 10.222.0.53 "GET /compute/v2.1/servers/a2ceae33-b8b9-4fe9-b507-4edb7d4a5403" status: 200 len: 1315 microversion: 2.1 time: 0.176082 Aug 27 04:33:05.183112 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 156/319] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:33:05 2021] GET /compute/v2.1/servers/a2ceae33-b8b9-4fe9-b507-4edb7d4a5403 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:05.231418 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-285ad00a-2a67-4167-9789-9732819e2d02 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:05.239479 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-285ad00a-2a67-4167-9789-9732819e2d02 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1522 microversion: 2.1 time: 0.194467 Aug 27 04:33:05.240119 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 164/320] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:33:05 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:06.013590 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-608e2c54-1ddf-4399-a370-7b06b7be686c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:06.014505 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-608e2c54-1ddf-4399-a370-7b06b7be686c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:06.020832 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-608e2c54-1ddf-4399-a370-7b06b7be686c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:06.021316 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-608e2c54-1ddf-4399-a370-7b06b7be686c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:06.022095 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-608e2c54-1ddf-4399-a370-7b06b7be686c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:06.022535 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-608e2c54-1ddf-4399-a370-7b06b7be686c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:06.059026 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-90019595-9ba8-4044-9cbb-2b36d72d95fd tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:06.059998 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-90019595-9ba8-4044-9cbb-2b36d72d95fd tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:06.066381 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-90019595-9ba8-4044-9cbb-2b36d72d95fd tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:06.066832 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-90019595-9ba8-4044-9cbb-2b36d72d95fd tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:06.067607 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-90019595-9ba8-4044-9cbb-2b36d72d95fd tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:06.068097 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-90019595-9ba8-4044-9cbb-2b36d72d95fd tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:06.155785 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-608e2c54-1ddf-4399-a370-7b06b7be686c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28584 microversion: 2.20 time: 0.146097 Aug 27 04:33:06.156457 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 157/321] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:33:06 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28584 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:33:06.197250 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-90019595-9ba8-4044-9cbb-2b36d72d95fd tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28642 microversion: 2.1 time: 0.141628 Aug 27 04:33:06.197802 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 165/322] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:33:06 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28642 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:33:06.200164 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-8cdac6cf-7992-45d0-91bb-fe0f112564ca tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:06.200862 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-8cdac6cf-7992-45d0-91bb-fe0f112564ca tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] [instance: a2ceae33-b8b9-4fe9-b507-4edb7d4a5403] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:06.207436 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-8cdac6cf-7992-45d0-91bb-fe0f112564ca tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:06.207881 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-8cdac6cf-7992-45d0-91bb-fe0f112564ca tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:06.209169 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-8cdac6cf-7992-45d0-91bb-fe0f112564ca tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:06.209599 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-8cdac6cf-7992-45d0-91bb-fe0f112564ca tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:06.257566 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-81f8f37e-e46d-4fd0-b2ed-2f34940fe7f8 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:06.258256 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-81f8f37e-e46d-4fd0-b2ed-2f34940fe7f8 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:06.264861 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-81f8f37e-e46d-4fd0-b2ed-2f34940fe7f8 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:06.265302 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-81f8f37e-e46d-4fd0-b2ed-2f34940fe7f8 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:06.266069 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-81f8f37e-e46d-4fd0-b2ed-2f34940fe7f8 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:06.266500 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-81f8f37e-e46d-4fd0-b2ed-2f34940fe7f8 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:06.335905 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-8cdac6cf-7992-45d0-91bb-fe0f112564ca tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54606e59672042dcbd37209fce5267fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7de2692ad114448ab4ce22c9e152f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:06.343455 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-8cdac6cf-7992-45d0-91bb-fe0f112564ca tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] 10.222.0.53 "GET /compute/v2.1/servers/a2ceae33-b8b9-4fe9-b507-4edb7d4a5403" status: 200 len: 1464 microversion: 2.1 time: 0.147274 Aug 27 04:33:06.344050 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 158/323] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:33:06 2021] GET /compute/v2.1/servers/a2ceae33-b8b9-4fe9-b507-4edb7d4a5403 => generated 1464 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:33:06.382558 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-f6d10f3b-1a75-4a6b-8609-da50ecd270f3 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:06.383052 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-f6d10f3b-1a75-4a6b-8609-da50ecd270f3 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] [instance: a2ceae33-b8b9-4fe9-b507-4edb7d4a5403] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:06.389149 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f6d10f3b-1a75-4a6b-8609-da50ecd270f3 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:06.389702 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f6d10f3b-1a75-4a6b-8609-da50ecd270f3 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:06.390484 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f6d10f3b-1a75-4a6b-8609-da50ecd270f3 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:06.390925 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f6d10f3b-1a75-4a6b-8609-da50ecd270f3 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:06.393938 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-81f8f37e-e46d-4fd0-b2ed-2f34940fe7f8 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:06.402119 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-81f8f37e-e46d-4fd0-b2ed-2f34940fe7f8 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1522 microversion: 2.1 time: 0.148693 Aug 27 04:33:06.402695 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 166/324] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:33:06 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:33:06.420978 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-f6d10f3b-1a75-4a6b-8609-da50ecd270f3 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] [instance: a2ceae33-b8b9-4fe9-b507-4edb7d4a5403] Going to try to terminate instance {{(pid=108970) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 04:33:06.511660 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-f6d10f3b-1a75-4a6b-8609-da50ecd270f3 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] 10.222.0.53 "DELETE /compute/v2.1/servers/a2ceae33-b8b9-4fe9-b507-4edb7d4a5403" status: 204 len: 0 microversion: 2.1 time: 0.132132 Aug 27 04:33:06.512278 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 159/325] 10.222.0.53 () {58 vars in 1239 bytes} [Fri Aug 27 04:33:06 2021] DELETE /compute/v2.1/servers/a2ceae33-b8b9-4fe9-b507-4edb7d4a5403 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 04:33:06.520121 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-dcf6a657-833b-4934-966f-838ae8bac053 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:06.520887 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-dcf6a657-833b-4934-966f-838ae8bac053 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] [instance: a2ceae33-b8b9-4fe9-b507-4edb7d4a5403] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:06.529377 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-dcf6a657-833b-4934-966f-838ae8bac053 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:06.529826 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-dcf6a657-833b-4934-966f-838ae8bac053 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:06.530615 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-dcf6a657-833b-4934-966f-838ae8bac053 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:06.531050 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-dcf6a657-833b-4934-966f-838ae8bac053 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:06.656626 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-dcf6a657-833b-4934-966f-838ae8bac053 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54606e59672042dcbd37209fce5267fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7de2692ad114448ab4ce22c9e152f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:06.664957 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-dcf6a657-833b-4934-966f-838ae8bac053 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] 10.222.0.53 "GET /compute/v2.1/servers/a2ceae33-b8b9-4fe9-b507-4edb7d4a5403" status: 200 len: 1470 microversion: 2.1 time: 0.148360 Aug 27 04:33:06.665524 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 167/326] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:33:06 2021] GET /compute/v2.1/servers/a2ceae33-b8b9-4fe9-b507-4edb7d4a5403 => generated 1470 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:07.167459 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-a0f28d17-5654-44cf-a569-ab2e5102119a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:07.169273 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-a0f28d17-5654-44cf-a569-ab2e5102119a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:07.175259 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a0f28d17-5654-44cf-a569-ab2e5102119a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:07.175704 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a0f28d17-5654-44cf-a569-ab2e5102119a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:07.176530 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a0f28d17-5654-44cf-a569-ab2e5102119a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:07.176964 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a0f28d17-5654-44cf-a569-ab2e5102119a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:07.208455 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-ec97c814-26f9-4571-8d12-c2c1b484f8fb tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:07.209742 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-ec97c814-26f9-4571-8d12-c2c1b484f8fb tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:07.215571 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ec97c814-26f9-4571-8d12-c2c1b484f8fb tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:07.216032 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ec97c814-26f9-4571-8d12-c2c1b484f8fb tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:07.216806 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ec97c814-26f9-4571-8d12-c2c1b484f8fb tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:07.217230 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ec97c814-26f9-4571-8d12-c2c1b484f8fb tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:07.324245 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-a0f28d17-5654-44cf-a569-ab2e5102119a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28584 microversion: 2.20 time: 0.160758 Aug 27 04:33:07.328342 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 160/327] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:33:07 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28584 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:33:07.395822 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-ec97c814-26f9-4571-8d12-c2c1b484f8fb tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28642 microversion: 2.1 time: 0.190809 Aug 27 04:33:07.396501 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 168/328] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:33:07 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28642 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:33:07.420415 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-d63b28b2-bcb2-40aa-8fdd-31860cfdf206 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:07.421113 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-d63b28b2-bcb2-40aa-8fdd-31860cfdf206 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:07.428194 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d63b28b2-bcb2-40aa-8fdd-31860cfdf206 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:07.428626 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d63b28b2-bcb2-40aa-8fdd-31860cfdf206 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:07.429402 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d63b28b2-bcb2-40aa-8fdd-31860cfdf206 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:07.429974 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d63b28b2-bcb2-40aa-8fdd-31860cfdf206 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:07.558290 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-d63b28b2-bcb2-40aa-8fdd-31860cfdf206 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:07.565842 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-d63b28b2-bcb2-40aa-8fdd-31860cfdf206 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1522 microversion: 2.1 time: 0.149403 Aug 27 04:33:07.566483 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 161/329] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:33:07 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:33:07.682100 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-9e057271-7326-4024-8de4-e0b3d5e74ead tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:07.682888 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-9e057271-7326-4024-8de4-e0b3d5e74ead tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] [instance: a2ceae33-b8b9-4fe9-b507-4edb7d4a5403] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:07.689757 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9e057271-7326-4024-8de4-e0b3d5e74ead tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:07.690155 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9e057271-7326-4024-8de4-e0b3d5e74ead tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:07.691063 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9e057271-7326-4024-8de4-e0b3d5e74ead tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:07.691630 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9e057271-7326-4024-8de4-e0b3d5e74ead tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:07.821904 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-9e057271-7326-4024-8de4-e0b3d5e74ead tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54606e59672042dcbd37209fce5267fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7de2692ad114448ab4ce22c9e152f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:07.829255 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-9e057271-7326-4024-8de4-e0b3d5e74ead tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] 10.222.0.53 "GET /compute/v2.1/servers/a2ceae33-b8b9-4fe9-b507-4edb7d4a5403" status: 200 len: 1470 microversion: 2.1 time: 0.151779 Aug 27 04:33:07.830928 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 169/330] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:33:07 2021] GET /compute/v2.1/servers/a2ceae33-b8b9-4fe9-b507-4edb7d4a5403 => generated 1470 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:08.336451 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-a034ae62-40c2-4bdd-a4d8-99db0b2af097 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:08.337497 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-a034ae62-40c2-4bdd-a4d8-99db0b2af097 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:08.343581 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a034ae62-40c2-4bdd-a4d8-99db0b2af097 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:08.344158 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a034ae62-40c2-4bdd-a4d8-99db0b2af097 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:08.344949 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a034ae62-40c2-4bdd-a4d8-99db0b2af097 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:08.345391 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a034ae62-40c2-4bdd-a4d8-99db0b2af097 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:08.407206 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-25804697-ad1b-4e78-85ee-f139a21c71e3 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:08.408831 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-25804697-ad1b-4e78-85ee-f139a21c71e3 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:08.415662 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-25804697-ad1b-4e78-85ee-f139a21c71e3 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:08.416146 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-25804697-ad1b-4e78-85ee-f139a21c71e3 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:08.416932 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-25804697-ad1b-4e78-85ee-f139a21c71e3 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:08.417366 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-25804697-ad1b-4e78-85ee-f139a21c71e3 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:08.478119 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-a034ae62-40c2-4bdd-a4d8-99db0b2af097 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28584 microversion: 2.20 time: 0.145410 Aug 27 04:33:08.482311 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 162/331] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:33:08 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28584 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:33:08.584374 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-b4dc6bed-4a7c-43cc-a62a-8f0760511dd9 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:08.584974 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-b4dc6bed-4a7c-43cc-a62a-8f0760511dd9 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:08.591524 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b4dc6bed-4a7c-43cc-a62a-8f0760511dd9 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:08.591969 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b4dc6bed-4a7c-43cc-a62a-8f0760511dd9 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:08.592988 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b4dc6bed-4a7c-43cc-a62a-8f0760511dd9 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:08.593425 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b4dc6bed-4a7c-43cc-a62a-8f0760511dd9 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:08.737639 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-b4dc6bed-4a7c-43cc-a62a-8f0760511dd9 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:08.746234 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-b4dc6bed-4a7c-43cc-a62a-8f0760511dd9 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1522 microversion: 2.1 time: 0.166325 Aug 27 04:33:08.746708 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 163/332] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:33:08 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:33:08.778333 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-25804697-ad1b-4e78-85ee-f139a21c71e3 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28642 microversion: 2.1 time: 0.375185 Aug 27 04:33:08.779019 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 170/333] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:33:08 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28642 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:33:08.856364 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-e29e5aed-a643-416d-a5ec-c459b3e7372a tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:08.856983 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-e29e5aed-a643-416d-a5ec-c459b3e7372a tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] [instance: a2ceae33-b8b9-4fe9-b507-4edb7d4a5403] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:08.863320 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e29e5aed-a643-416d-a5ec-c459b3e7372a tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:08.863764 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e29e5aed-a643-416d-a5ec-c459b3e7372a tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:08.865357 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e29e5aed-a643-416d-a5ec-c459b3e7372a tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:08.865807 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e29e5aed-a643-416d-a5ec-c459b3e7372a tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:09.010361 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-e29e5aed-a643-416d-a5ec-c459b3e7372a tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54606e59672042dcbd37209fce5267fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7de2692ad114448ab4ce22c9e152f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:09.018028 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-e29e5aed-a643-416d-a5ec-c459b3e7372a tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] 10.222.0.53 "GET /compute/v2.1/servers/a2ceae33-b8b9-4fe9-b507-4edb7d4a5403" status: 200 len: 1470 microversion: 2.1 time: 0.165957 Aug 27 04:33:09.018592 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 164/334] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:33:08 2021] GET /compute/v2.1/servers/a2ceae33-b8b9-4fe9-b507-4edb7d4a5403 => generated 1470 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:09.490738 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-51b299e1-5ec2-4aca-8c63-409be86d61a3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:09.491755 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-51b299e1-5ec2-4aca-8c63-409be86d61a3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:09.498670 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-51b299e1-5ec2-4aca-8c63-409be86d61a3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:09.499111 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-51b299e1-5ec2-4aca-8c63-409be86d61a3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:09.499887 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-51b299e1-5ec2-4aca-8c63-409be86d61a3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:09.500344 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-51b299e1-5ec2-4aca-8c63-409be86d61a3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:09.664693 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-51b299e1-5ec2-4aca-8c63-409be86d61a3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28584 microversion: 2.20 time: 0.178179 Aug 27 04:33:09.665248 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 171/335] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:33:09 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28584 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:33:09.763602 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-7719dfd0-304b-4343-98a1-e731f21cd1de tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:09.764255 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-7719dfd0-304b-4343-98a1-e731f21cd1de tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:09.770647 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7719dfd0-304b-4343-98a1-e731f21cd1de tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:09.771102 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7719dfd0-304b-4343-98a1-e731f21cd1de tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:09.771891 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7719dfd0-304b-4343-98a1-e731f21cd1de tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:09.772372 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7719dfd0-304b-4343-98a1-e731f21cd1de tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:09.792100 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-636f0c15-36ec-4c6f-b57f-4d1a4cf868a2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:09.793137 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-636f0c15-36ec-4c6f-b57f-4d1a4cf868a2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:09.799525 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-636f0c15-36ec-4c6f-b57f-4d1a4cf868a2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:09.799972 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-636f0c15-36ec-4c6f-b57f-4d1a4cf868a2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:09.800778 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-636f0c15-36ec-4c6f-b57f-4d1a4cf868a2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:09.801403 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-636f0c15-36ec-4c6f-b57f-4d1a4cf868a2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:09.898868 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-636f0c15-36ec-4c6f-b57f-4d1a4cf868a2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28642 microversion: 2.1 time: 0.111926 Aug 27 04:33:09.899811 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 172/336] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:33:09 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28642 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:33:09.903128 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-7719dfd0-304b-4343-98a1-e731f21cd1de tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:09.910568 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-7719dfd0-304b-4343-98a1-e731f21cd1de tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1522 microversion: 2.1 time: 0.150647 Aug 27 04:33:09.911137 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 165/337] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:33:09 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:10.035091 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-0e62a8b4-20d7-420d-b97c-fdceb40ddb9a tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:10.035779 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-0e62a8b4-20d7-420d-b97c-fdceb40ddb9a tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] [instance: a2ceae33-b8b9-4fe9-b507-4edb7d4a5403] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:10.043055 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0e62a8b4-20d7-420d-b97c-fdceb40ddb9a tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:10.043494 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0e62a8b4-20d7-420d-b97c-fdceb40ddb9a tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:10.044280 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0e62a8b4-20d7-420d-b97c-fdceb40ddb9a tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:10.044708 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0e62a8b4-20d7-420d-b97c-fdceb40ddb9a tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:10.298713 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [req-3b3ed661-05d6-4348-a45a-b28c5c8a1c31 req-b2c02fd7-8f44-41af-b636-359bd2188203 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2ceae33-b8b9-4fe9-b507-4edb7d4a5403", "name": "network-vif-deleted", "tag": "ca061db2-994e-4835-9544-62ab84abf718"}]} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:10.305918 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-0e62a8b4-20d7-420d-b97c-fdceb40ddb9a tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54606e59672042dcbd37209fce5267fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7de2692ad114448ab4ce22c9e152f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:10.306125 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:33:10.306125 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: warnings.warn(msg) Aug 27 04:33:10.310900 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-0e62a8b4-20d7-420d-b97c-fdceb40ddb9a tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] 10.222.0.53 "GET /compute/v2.1/servers/a2ceae33-b8b9-4fe9-b507-4edb7d4a5403" status: 200 len: 1470 microversion: 2.1 time: 0.279791 Aug 27 04:33:10.311857 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 173/338] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:33:10 2021] GET /compute/v2.1/servers/a2ceae33-b8b9-4fe9-b507-4edb7d4a5403 => generated 1470 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:10.313083 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-3b3ed661-05d6-4348-a45a-b28c5c8a1c31 req-b2c02fd7-8f44-41af-b636-359bd2188203 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:10.313538 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-3b3ed661-05d6-4348-a45a-b28c5c8a1c31 req-b2c02fd7-8f44-41af-b636-359bd2188203 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:10.326645 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.compute.server_external_events [req-3b3ed661-05d6-4348-a45a-b28c5c8a1c31 req-b2c02fd7-8f44-41af-b636-359bd2188203 service nova] Creating event network-vif-deleted:ca061db2-994e-4835-9544-62ab84abf718 for instance a2ceae33-b8b9-4fe9-b507-4edb7d4a5403 on hv-cinder-80403 Aug 27 04:33:10.332201 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [req-3b3ed661-05d6-4348-a45a-b28c5c8a1c31 req-b2c02fd7-8f44-41af-b636-359bd2188203 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037090 Aug 27 04:33:10.333086 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 166/339] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:33:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:33:10.676201 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-00701bc1-b2bd-4ba6-9756-4580b1ce8232 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:10.677617 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-00701bc1-b2bd-4ba6-9756-4580b1ce8232 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:10.683719 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-00701bc1-b2bd-4ba6-9756-4580b1ce8232 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:10.684207 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-00701bc1-b2bd-4ba6-9756-4580b1ce8232 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:10.684984 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-00701bc1-b2bd-4ba6-9756-4580b1ce8232 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:10.685423 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-00701bc1-b2bd-4ba6-9756-4580b1ce8232 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:10.791621 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-00701bc1-b2bd-4ba6-9756-4580b1ce8232 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28584 microversion: 2.20 time: 0.118992 Aug 27 04:33:10.792304 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 174/340] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:33:10 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28584 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:33:10.911299 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-81f0d080-d160-4f5b-b2c9-72e322d065a2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:10.912423 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-81f0d080-d160-4f5b-b2c9-72e322d065a2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:10.918884 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-81f0d080-d160-4f5b-b2c9-72e322d065a2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:10.919565 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-81f0d080-d160-4f5b-b2c9-72e322d065a2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:10.920131 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-81f0d080-d160-4f5b-b2c9-72e322d065a2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:10.920577 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-81f0d080-d160-4f5b-b2c9-72e322d065a2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:10.933342 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-e69ff7db-a4da-4e7f-a850-107b3e169e4e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:10.934397 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-e69ff7db-a4da-4e7f-a850-107b3e169e4e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:10.945378 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e69ff7db-a4da-4e7f-a850-107b3e169e4e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:10.946154 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e69ff7db-a4da-4e7f-a850-107b3e169e4e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:10.947057 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e69ff7db-a4da-4e7f-a850-107b3e169e4e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:10.947578 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e69ff7db-a4da-4e7f-a850-107b3e169e4e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:11.037190 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-81f0d080-d160-4f5b-b2c9-72e322d065a2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28642 microversion: 2.1 time: 0.129734 Aug 27 04:33:11.038842 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 167/341] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:33:10 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28642 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:33:11.084767 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-e69ff7db-a4da-4e7f-a850-107b3e169e4e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:11.092025 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-e69ff7db-a4da-4e7f-a850-107b3e169e4e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1522 microversion: 2.1 time: 0.166332 Aug 27 04:33:11.092757 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 175/342] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:33:10 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:11.330626 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-f8ba5e74-cfa1-431c-b101-82701157eab0 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:11.331320 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-f8ba5e74-cfa1-431c-b101-82701157eab0 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] [instance: a2ceae33-b8b9-4fe9-b507-4edb7d4a5403] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:11.338070 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f8ba5e74-cfa1-431c-b101-82701157eab0 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:11.338516 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f8ba5e74-cfa1-431c-b101-82701157eab0 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:11.339286 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f8ba5e74-cfa1-431c-b101-82701157eab0 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:11.339715 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f8ba5e74-cfa1-431c-b101-82701157eab0 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:11.353663 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.wsgi [None req-f8ba5e74-cfa1-431c-b101-82701157eab0 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] HTTP exception thrown: Instance a2ceae33-b8b9-4fe9-b507-4edb7d4a5403 could not be found. Aug 27 04:33:11.354260 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-f8ba5e74-cfa1-431c-b101-82701157eab0 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] Returning 404 to user: Instance a2ceae33-b8b9-4fe9-b507-4edb7d4a5403 could not be found. {{(pid=108970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:33:11.355083 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-f8ba5e74-cfa1-431c-b101-82701157eab0 tempest-VolumesNegativeTest-620229132 tempest-VolumesNegativeTest-620229132-project] 10.222.0.53 "GET /compute/v2.1/servers/a2ceae33-b8b9-4fe9-b507-4edb7d4a5403" status: 404 len: 111 microversion: 2.1 time: 0.028831 Aug 27 04:33:11.355628 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 168/343] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:33:11 2021] GET /compute/v2.1/servers/a2ceae33-b8b9-4fe9-b507-4edb7d4a5403 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:33:11.802587 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-a41b096e-a3e6-4990-a531-23e1dc624493 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:11.803485 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-a41b096e-a3e6-4990-a531-23e1dc624493 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:11.810710 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a41b096e-a3e6-4990-a531-23e1dc624493 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:11.811411 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a41b096e-a3e6-4990-a531-23e1dc624493 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:11.812345 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a41b096e-a3e6-4990-a531-23e1dc624493 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:11.812891 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a41b096e-a3e6-4990-a531-23e1dc624493 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:11.914554 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-a41b096e-a3e6-4990-a531-23e1dc624493 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28584 microversion: 2.20 time: 0.115436 Aug 27 04:33:11.915204 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 176/344] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:33:11 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28584 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:33:12.050146 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-ed1b9ee3-4800-4045-88e3-96fa41090607 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:12.051641 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-ed1b9ee3-4800-4045-88e3-96fa41090607 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:12.058059 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ed1b9ee3-4800-4045-88e3-96fa41090607 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:12.058515 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ed1b9ee3-4800-4045-88e3-96fa41090607 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:12.059313 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ed1b9ee3-4800-4045-88e3-96fa41090607 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:12.059769 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ed1b9ee3-4800-4045-88e3-96fa41090607 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:12.110130 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-c59e95de-c88f-4f39-9361-557781bd778b tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:12.110838 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-c59e95de-c88f-4f39-9361-557781bd778b tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:12.118364 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c59e95de-c88f-4f39-9361-557781bd778b tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:12.118809 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c59e95de-c88f-4f39-9361-557781bd778b tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:12.119583 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c59e95de-c88f-4f39-9361-557781bd778b tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:12.120709 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c59e95de-c88f-4f39-9361-557781bd778b tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:12.228138 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-ed1b9ee3-4800-4045-88e3-96fa41090607 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28642 microversion: 2.1 time: 0.181515 Aug 27 04:33:12.229239 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 169/345] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:33:12 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28642 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:33:12.450520 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-c59e95de-c88f-4f39-9361-557781bd778b tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:12.459171 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-c59e95de-c88f-4f39-9361-557781bd778b tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1522 microversion: 2.1 time: 0.352769 Aug 27 04:33:12.459741 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 177/346] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:33:12 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1522 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:12.928365 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-b86c36c2-cdec-4f53-a06f-dae215968013 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:12.929437 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-b86c36c2-cdec-4f53-a06f-dae215968013 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:12.935846 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b86c36c2-cdec-4f53-a06f-dae215968013 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:12.936401 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b86c36c2-cdec-4f53-a06f-dae215968013 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:12.937183 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b86c36c2-cdec-4f53-a06f-dae215968013 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:12.937682 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b86c36c2-cdec-4f53-a06f-dae215968013 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:13.050499 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-b86c36c2-cdec-4f53-a06f-dae215968013 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28584 microversion: 2.20 time: 0.126673 Aug 27 04:33:13.051201 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 170/347] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:33:12 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28584 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:33:13.241950 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-8da99a2b-1e69-4090-b7ab-05e60a056404 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:13.243284 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-8da99a2b-1e69-4090-b7ab-05e60a056404 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:13.250244 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8da99a2b-1e69-4090-b7ab-05e60a056404 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:13.251021 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8da99a2b-1e69-4090-b7ab-05e60a056404 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:13.252099 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8da99a2b-1e69-4090-b7ab-05e60a056404 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:13.252597 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8da99a2b-1e69-4090-b7ab-05e60a056404 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:13.364630 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-8da99a2b-1e69-4090-b7ab-05e60a056404 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28642 microversion: 2.1 time: 0.124608 Aug 27 04:33:13.369787 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 178/348] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:33:13 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28642 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:33:13.477135 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-501a2d40-9c16-4ffc-a2fc-e82056352df7 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:13.477787 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-501a2d40-9c16-4ffc-a2fc-e82056352df7 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:13.484532 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-501a2d40-9c16-4ffc-a2fc-e82056352df7 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:13.484983 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-501a2d40-9c16-4ffc-a2fc-e82056352df7 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:13.485835 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-501a2d40-9c16-4ffc-a2fc-e82056352df7 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:13.486226 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-501a2d40-9c16-4ffc-a2fc-e82056352df7 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:13.659793 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-501a2d40-9c16-4ffc-a2fc-e82056352df7 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:13.671926 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-501a2d40-9c16-4ffc-a2fc-e82056352df7 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1522 microversion: 2.1 time: 0.199476 Aug 27 04:33:13.672618 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 171/349] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:33:13 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:14.063154 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-42871117-f2ef-4cc0-94b1-7b5a4659a452 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:14.064270 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-42871117-f2ef-4cc0-94b1-7b5a4659a452 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:14.071490 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-42871117-f2ef-4cc0-94b1-7b5a4659a452 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:14.071935 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-42871117-f2ef-4cc0-94b1-7b5a4659a452 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:14.072739 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-42871117-f2ef-4cc0-94b1-7b5a4659a452 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:14.073168 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-42871117-f2ef-4cc0-94b1-7b5a4659a452 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:14.188524 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-42871117-f2ef-4cc0-94b1-7b5a4659a452 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28584 microversion: 2.20 time: 0.129200 Aug 27 04:33:14.194202 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 179/350] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:33:14 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28584 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:33:14.376799 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-d048fc58-9ea8-4d23-84ab-6003de05b368 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:14.377746 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-d048fc58-9ea8-4d23-84ab-6003de05b368 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:14.384312 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d048fc58-9ea8-4d23-84ab-6003de05b368 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:14.384761 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d048fc58-9ea8-4d23-84ab-6003de05b368 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:14.385533 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d048fc58-9ea8-4d23-84ab-6003de05b368 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:14.385968 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d048fc58-9ea8-4d23-84ab-6003de05b368 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:14.486054 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-d048fc58-9ea8-4d23-84ab-6003de05b368 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28642 microversion: 2.1 time: 0.112851 Aug 27 04:33:14.486699 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 172/351] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:33:14 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28642 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:33:14.690506 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-a02b8b3e-92fb-4060-bc7a-ac14bd98106a tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:14.691119 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-a02b8b3e-92fb-4060-bc7a-ac14bd98106a tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:14.697745 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a02b8b3e-92fb-4060-bc7a-ac14bd98106a tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:14.698192 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a02b8b3e-92fb-4060-bc7a-ac14bd98106a tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:14.698964 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a02b8b3e-92fb-4060-bc7a-ac14bd98106a tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:14.699398 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a02b8b3e-92fb-4060-bc7a-ac14bd98106a tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:14.824527 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-a02b8b3e-92fb-4060-bc7a-ac14bd98106a tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:14.832963 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-a02b8b3e-92fb-4060-bc7a-ac14bd98106a tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1522 microversion: 2.1 time: 0.146553 Aug 27 04:33:14.834141 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 180/352] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:33:14 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:15.203376 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-28083ca0-bb96-4090-b46f-15eaeec243d3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:15.204393 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-28083ca0-bb96-4090-b46f-15eaeec243d3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:15.211562 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-28083ca0-bb96-4090-b46f-15eaeec243d3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:15.212024 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-28083ca0-bb96-4090-b46f-15eaeec243d3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:15.212808 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-28083ca0-bb96-4090-b46f-15eaeec243d3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:15.213237 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-28083ca0-bb96-4090-b46f-15eaeec243d3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:15.497595 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-56200090-7338-49a4-bcb9-73d77364ed46 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:15.498512 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-56200090-7338-49a4-bcb9-73d77364ed46 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:15.504834 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-56200090-7338-49a4-bcb9-73d77364ed46 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:15.505420 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-56200090-7338-49a4-bcb9-73d77364ed46 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:15.506278 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-56200090-7338-49a4-bcb9-73d77364ed46 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:15.506717 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-56200090-7338-49a4-bcb9-73d77364ed46 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:19.309296 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-28083ca0-bb96-4090-b46f-15eaeec243d3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28584 microversion: 2.20 time: 4.110619 Aug 27 04:33:19.311083 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 173/353] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:33:15 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28584 bytes in 4113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:33:19.315881 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-6ab303d9-051f-4c28-ab3b-2ccd38d901ed tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:19.316611 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-6ab303d9-051f-4c28-ab3b-2ccd38d901ed tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:19.323439 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6ab303d9-051f-4c28-ab3b-2ccd38d901ed tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:19.323917 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6ab303d9-051f-4c28-ab3b-2ccd38d901ed tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:19.324711 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6ab303d9-051f-4c28-ab3b-2ccd38d901ed tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:19.325152 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6ab303d9-051f-4c28-ab3b-2ccd38d901ed tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:19.372294 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-56200090-7338-49a4-bcb9-73d77364ed46 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28642 microversion: 2.1 time: 3.878173 Aug 27 04:33:19.372938 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 181/354] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:33:15 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28642 bytes in 3880 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:33:19.449750 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-6ab303d9-051f-4c28-ab3b-2ccd38d901ed tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:19.457159 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-6ab303d9-051f-4c28-ab3b-2ccd38d901ed tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1522 microversion: 2.1 time: 0.144986 Aug 27 04:33:19.457762 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 174/355] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:33:19 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:20.325281 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-3379dda3-dc9d-4875-8c11-e27135810de9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:20.326378 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-3379dda3-dc9d-4875-8c11-e27135810de9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:20.333660 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3379dda3-dc9d-4875-8c11-e27135810de9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:20.334110 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3379dda3-dc9d-4875-8c11-e27135810de9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:20.334923 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3379dda3-dc9d-4875-8c11-e27135810de9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:20.335356 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3379dda3-dc9d-4875-8c11-e27135810de9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:20.384528 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-b2c63eca-fb07-427d-8e0e-e058c9eca585 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:20.385531 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-b2c63eca-fb07-427d-8e0e-e058c9eca585 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:20.391828 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b2c63eca-fb07-427d-8e0e-e058c9eca585 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:20.392317 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b2c63eca-fb07-427d-8e0e-e058c9eca585 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:20.393094 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b2c63eca-fb07-427d-8e0e-e058c9eca585 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:20.393533 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b2c63eca-fb07-427d-8e0e-e058c9eca585 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:20.473704 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-3379dda3-dc9d-4875-8c11-e27135810de9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28584 microversion: 2.20 time: 0.155867 Aug 27 04:33:20.474349 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 182/356] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:33:20 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28584 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:33:20.479372 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-86a0a634-9d6f-4e14-9356-ce0fba93d7d8 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:20.480079 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-86a0a634-9d6f-4e14-9356-ce0fba93d7d8 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:20.486758 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-86a0a634-9d6f-4e14-9356-ce0fba93d7d8 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:20.487195 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-86a0a634-9d6f-4e14-9356-ce0fba93d7d8 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:20.487965 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-86a0a634-9d6f-4e14-9356-ce0fba93d7d8 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:20.488419 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-86a0a634-9d6f-4e14-9356-ce0fba93d7d8 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:20.511582 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-b2c63eca-fb07-427d-8e0e-e058c9eca585 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28642 microversion: 2.1 time: 0.131083 Aug 27 04:33:20.513073 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 175/357] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:33:20 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28642 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:33:20.616367 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-86a0a634-9d6f-4e14-9356-ce0fba93d7d8 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:20.623968 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-86a0a634-9d6f-4e14-9356-ce0fba93d7d8 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1522 microversion: 2.1 time: 0.148469 Aug 27 04:33:20.624565 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 183/358] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:33:20 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:21.485272 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-7dd51e53-0c05-451a-b165-81211313caab tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:21.486265 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-7dd51e53-0c05-451a-b165-81211313caab tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:21.493035 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7dd51e53-0c05-451a-b165-81211313caab tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:21.493750 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7dd51e53-0c05-451a-b165-81211313caab tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:21.495556 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7dd51e53-0c05-451a-b165-81211313caab tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:21.495556 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7dd51e53-0c05-451a-b165-81211313caab tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:21.524916 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-53786e97-1ed8-4fab-ae59-c45e7b42f6cb tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:21.525860 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-53786e97-1ed8-4fab-ae59-c45e7b42f6cb tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:21.532190 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-53786e97-1ed8-4fab-ae59-c45e7b42f6cb tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:21.532636 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-53786e97-1ed8-4fab-ae59-c45e7b42f6cb tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:21.533403 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-53786e97-1ed8-4fab-ae59-c45e7b42f6cb tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:21.533835 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-53786e97-1ed8-4fab-ae59-c45e7b42f6cb tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:21.617191 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-7dd51e53-0c05-451a-b165-81211313caab tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28584 microversion: 2.20 time: 0.135762 Aug 27 04:33:21.618143 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 176/359] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:33:21 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28584 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:33:21.641946 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-bb9b4e7a-3d87-4a63-81e9-7d5957e49916 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:21.642563 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-bb9b4e7a-3d87-4a63-81e9-7d5957e49916 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:21.649117 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-53786e97-1ed8-4fab-ae59-c45e7b42f6cb tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28642 microversion: 2.1 time: 0.128525 Aug 27 04:33:21.653021 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 184/360] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:33:21 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28642 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:33:21.653177 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-bb9b4e7a-3d87-4a63-81e9-7d5957e49916 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:21.653177 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-bb9b4e7a-3d87-4a63-81e9-7d5957e49916 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:21.653177 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-bb9b4e7a-3d87-4a63-81e9-7d5957e49916 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:21.653177 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-bb9b4e7a-3d87-4a63-81e9-7d5957e49916 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:21.783570 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-bb9b4e7a-3d87-4a63-81e9-7d5957e49916 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:21.794438 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-bb9b4e7a-3d87-4a63-81e9-7d5957e49916 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1522 microversion: 2.1 time: 0.156372 Aug 27 04:33:21.795022 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 177/361] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:33:21 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:33:22.628938 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-e088266b-d1e3-435e-892f-b3288a7c1859 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:22.629936 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-e088266b-d1e3-435e-892f-b3288a7c1859 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:22.636544 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e088266b-d1e3-435e-892f-b3288a7c1859 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:22.636993 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e088266b-d1e3-435e-892f-b3288a7c1859 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:22.637776 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e088266b-d1e3-435e-892f-b3288a7c1859 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:22.638206 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e088266b-d1e3-435e-892f-b3288a7c1859 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:22.660520 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-ed5dca18-11ed-4958-ba9b-443a4769bdd7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:22.661442 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-ed5dca18-11ed-4958-ba9b-443a4769bdd7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:22.668593 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ed5dca18-11ed-4958-ba9b-443a4769bdd7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:22.669047 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ed5dca18-11ed-4958-ba9b-443a4769bdd7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:22.669831 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ed5dca18-11ed-4958-ba9b-443a4769bdd7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:22.670274 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ed5dca18-11ed-4958-ba9b-443a4769bdd7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:22.776200 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-e088266b-d1e3-435e-892f-b3288a7c1859 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28584 microversion: 2.20 time: 0.151127 Aug 27 04:33:22.776846 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 185/362] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:33:22 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28584 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:33:22.808855 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-ed5dca18-11ed-4958-ba9b-443a4769bdd7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28642 microversion: 2.1 time: 0.151773 Aug 27 04:33:22.809732 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 178/363] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:33:22 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28642 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:33:22.811878 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-c9d3e85f-2b93-4ddf-9324-b8c8d7ef1c91 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:22.812592 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-c9d3e85f-2b93-4ddf-9324-b8c8d7ef1c91 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:22.819263 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c9d3e85f-2b93-4ddf-9324-b8c8d7ef1c91 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:22.819701 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c9d3e85f-2b93-4ddf-9324-b8c8d7ef1c91 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:22.820494 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c9d3e85f-2b93-4ddf-9324-b8c8d7ef1c91 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:22.820923 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c9d3e85f-2b93-4ddf-9324-b8c8d7ef1c91 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:22.947914 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-c9d3e85f-2b93-4ddf-9324-b8c8d7ef1c91 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:22.955644 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-c9d3e85f-2b93-4ddf-9324-b8c8d7ef1c91 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1522 microversion: 2.1 time: 0.147788 Aug 27 04:33:22.956247 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 186/364] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:33:22 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:33:23.789138 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-602f14c9-cdef-4065-9700-63efecd89ff5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:23.790150 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-602f14c9-cdef-4065-9700-63efecd89ff5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:23.796706 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-602f14c9-cdef-4065-9700-63efecd89ff5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:23.797193 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-602f14c9-cdef-4065-9700-63efecd89ff5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:23.797978 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-602f14c9-cdef-4065-9700-63efecd89ff5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:23.798421 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-602f14c9-cdef-4065-9700-63efecd89ff5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:23.820449 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-46e0ef70-22f3-43ca-acf3-bbc8b054b953 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:23.821409 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-46e0ef70-22f3-43ca-acf3-bbc8b054b953 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:23.828671 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-46e0ef70-22f3-43ca-acf3-bbc8b054b953 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:23.829242 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-46e0ef70-22f3-43ca-acf3-bbc8b054b953 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:23.830051 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-46e0ef70-22f3-43ca-acf3-bbc8b054b953 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:23.830487 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-46e0ef70-22f3-43ca-acf3-bbc8b054b953 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:23.947835 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-602f14c9-cdef-4065-9700-63efecd89ff5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28584 microversion: 2.20 time: 0.163307 Aug 27 04:33:23.948516 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 179/365] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:33:23 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28584 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:33:23.971794 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-46e0ef70-22f3-43ca-acf3-bbc8b054b953 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28642 microversion: 2.1 time: 0.155579 Aug 27 04:33:23.972704 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 187/366] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:33:23 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28642 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:33:23.973082 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-b2f11241-46df-4dd3-aa30-9ade831afa52 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:23.973787 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-b2f11241-46df-4dd3-aa30-9ade831afa52 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:23.980511 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b2f11241-46df-4dd3-aa30-9ade831afa52 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:23.981122 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b2f11241-46df-4dd3-aa30-9ade831afa52 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:23.981910 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b2f11241-46df-4dd3-aa30-9ade831afa52 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:23.982365 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b2f11241-46df-4dd3-aa30-9ade831afa52 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:24.114723 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-b2f11241-46df-4dd3-aa30-9ade831afa52 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:24.122319 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-b2f11241-46df-4dd3-aa30-9ade831afa52 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1522 microversion: 2.1 time: 0.153583 Aug 27 04:33:24.122882 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 180/367] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:33:23 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:33:24.960060 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-30910263-1182-413c-9c7a-b37bba10fdbc tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:24.961079 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-30910263-1182-413c-9c7a-b37bba10fdbc tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:24.967832 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-30910263-1182-413c-9c7a-b37bba10fdbc tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:24.968317 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-30910263-1182-413c-9c7a-b37bba10fdbc tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:24.969277 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-30910263-1182-413c-9c7a-b37bba10fdbc tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:24.969633 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-30910263-1182-413c-9c7a-b37bba10fdbc tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:24.982648 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-bd97d92a-4cbe-4498-b049-7d298c246b68 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:24.983705 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-bd97d92a-4cbe-4498-b049-7d298c246b68 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:24.990946 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-bd97d92a-4cbe-4498-b049-7d298c246b68 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:24.991688 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-bd97d92a-4cbe-4498-b049-7d298c246b68 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:24.992776 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-bd97d92a-4cbe-4498-b049-7d298c246b68 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:24.993210 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-bd97d92a-4cbe-4498-b049-7d298c246b68 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:25.107294 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-30910263-1182-413c-9c7a-b37bba10fdbc tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28584 microversion: 2.20 time: 0.151205 Aug 27 04:33:25.108025 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 188/368] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:33:24 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28584 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:33:25.140453 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-0ba1b771-1e3c-4fe3-8841-0976f1c71b47 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:25.141281 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-0ba1b771-1e3c-4fe3-8841-0976f1c71b47 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:25.144476 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-bd97d92a-4cbe-4498-b049-7d298c246b68 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28642 microversion: 2.1 time: 0.165230 Aug 27 04:33:25.148351 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0ba1b771-1e3c-4fe3-8841-0976f1c71b47 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:25.149005 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0ba1b771-1e3c-4fe3-8841-0976f1c71b47 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:25.149151 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 181/369] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:33:24 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28642 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:33:25.150251 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0ba1b771-1e3c-4fe3-8841-0976f1c71b47 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:25.150716 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0ba1b771-1e3c-4fe3-8841-0976f1c71b47 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:25.288204 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-0ba1b771-1e3c-4fe3-8841-0976f1c71b47 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:25.296633 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-0ba1b771-1e3c-4fe3-8841-0976f1c71b47 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1522 microversion: 2.1 time: 0.160320 Aug 27 04:33:25.297227 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 189/370] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:33:25 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:33:26.120881 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-2cc1a37d-fdb8-4954-ac43-b74b28f2df6d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:26.121902 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-2cc1a37d-fdb8-4954-ac43-b74b28f2df6d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:26.128440 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2cc1a37d-fdb8-4954-ac43-b74b28f2df6d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:26.128908 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2cc1a37d-fdb8-4954-ac43-b74b28f2df6d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:26.129924 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2cc1a37d-fdb8-4954-ac43-b74b28f2df6d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:26.130352 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2cc1a37d-fdb8-4954-ac43-b74b28f2df6d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:26.156595 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-a597b918-d41f-4265-a532-b0f4de3ea20a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:26.157502 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-a597b918-d41f-4265-a532-b0f4de3ea20a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:26.164545 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a597b918-d41f-4265-a532-b0f4de3ea20a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:26.164985 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a597b918-d41f-4265-a532-b0f4de3ea20a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:26.165749 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a597b918-d41f-4265-a532-b0f4de3ea20a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:26.166170 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a597b918-d41f-4265-a532-b0f4de3ea20a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:26.263422 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-2cc1a37d-fdb8-4954-ac43-b74b28f2df6d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28584 microversion: 2.20 time: 0.147570 Aug 27 04:33:26.264119 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 182/371] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:33:26 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28584 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:33:26.301435 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-a597b918-d41f-4265-a532-b0f4de3ea20a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28642 microversion: 2.1 time: 0.148253 Aug 27 04:33:26.302080 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 190/372] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:33:26 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28642 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:33:26.314923 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-d8ea9c12-187e-49b4-84fd-eca314b04525 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:26.315619 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-d8ea9c12-187e-49b4-84fd-eca314b04525 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:26.323019 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d8ea9c12-187e-49b4-84fd-eca314b04525 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:26.323473 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d8ea9c12-187e-49b4-84fd-eca314b04525 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:26.324291 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d8ea9c12-187e-49b4-84fd-eca314b04525 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:26.324735 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d8ea9c12-187e-49b4-84fd-eca314b04525 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:26.449405 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-d8ea9c12-187e-49b4-84fd-eca314b04525 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:26.456905 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-d8ea9c12-187e-49b4-84fd-eca314b04525 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1522 microversion: 2.1 time: 0.146007 Aug 27 04:33:26.457476 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 183/373] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:33:26 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:27.276876 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-75fdd935-b82c-4999-a1ac-943e4f885bcd tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:27.277932 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-75fdd935-b82c-4999-a1ac-943e4f885bcd tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:27.284668 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-75fdd935-b82c-4999-a1ac-943e4f885bcd tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:27.285109 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-75fdd935-b82c-4999-a1ac-943e4f885bcd tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:27.285886 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-75fdd935-b82c-4999-a1ac-943e4f885bcd tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:27.286500 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-75fdd935-b82c-4999-a1ac-943e4f885bcd tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:27.313883 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-45024c66-b688-4057-b92f-f16c96c8ef3f tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:27.316506 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-45024c66-b688-4057-b92f-f16c96c8ef3f tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:27.325178 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-45024c66-b688-4057-b92f-f16c96c8ef3f tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:27.325675 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-45024c66-b688-4057-b92f-f16c96c8ef3f tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:27.326473 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-45024c66-b688-4057-b92f-f16c96c8ef3f tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:27.327082 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-45024c66-b688-4057-b92f-f16c96c8ef3f tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:27.396055 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-75fdd935-b82c-4999-a1ac-943e4f885bcd tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28584 microversion: 2.20 time: 0.123022 Aug 27 04:33:27.397973 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 191/374] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:33:27 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28584 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:33:27.469986 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-45024c66-b688-4057-b92f-f16c96c8ef3f tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28642 microversion: 2.1 time: 0.160307 Aug 27 04:33:27.471273 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 184/375] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:33:27 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28642 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:33:27.474215 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-529e3425-bf6a-4574-b199-69a45731963d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:27.475559 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-529e3425-bf6a-4574-b199-69a45731963d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:27.481875 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-529e3425-bf6a-4574-b199-69a45731963d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:27.482315 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-529e3425-bf6a-4574-b199-69a45731963d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:27.483119 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-529e3425-bf6a-4574-b199-69a45731963d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:27.483553 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-529e3425-bf6a-4574-b199-69a45731963d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:27.619537 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-529e3425-bf6a-4574-b199-69a45731963d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:27.626957 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-529e3425-bf6a-4574-b199-69a45731963d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1522 microversion: 2.1 time: 0.157162 Aug 27 04:33:27.627539 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 192/376] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:33:27 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:33:28.410493 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-d6078e0f-1ed8-4661-b802-29ed69d0234c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:28.411495 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-d6078e0f-1ed8-4661-b802-29ed69d0234c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:28.418075 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d6078e0f-1ed8-4661-b802-29ed69d0234c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:28.418532 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d6078e0f-1ed8-4661-b802-29ed69d0234c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:28.419322 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d6078e0f-1ed8-4661-b802-29ed69d0234c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:28.419763 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d6078e0f-1ed8-4661-b802-29ed69d0234c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:28.481120 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-9a28fe5e-fe3f-44b7-ac2f-b886a4f17266 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:28.482023 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-9a28fe5e-fe3f-44b7-ac2f-b886a4f17266 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:28.488330 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9a28fe5e-fe3f-44b7-ac2f-b886a4f17266 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:28.488770 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9a28fe5e-fe3f-44b7-ac2f-b886a4f17266 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:28.489527 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9a28fe5e-fe3f-44b7-ac2f-b886a4f17266 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:28.489953 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9a28fe5e-fe3f-44b7-ac2f-b886a4f17266 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:28.520627 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-d6078e0f-1ed8-4661-b802-29ed69d0234c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28584 microversion: 2.20 time: 0.113987 Aug 27 04:33:28.521296 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 185/377] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:33:28 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28584 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:33:28.606331 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-9a28fe5e-fe3f-44b7-ac2f-b886a4f17266 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28642 microversion: 2.1 time: 0.128624 Aug 27 04:33:28.607009 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 193/378] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:33:28 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28642 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:33:28.647540 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-9bb1cb14-06fe-43d7-9e67-3475c8ac2d23 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:28.648206 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-9bb1cb14-06fe-43d7-9e67-3475c8ac2d23 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:28.656976 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9bb1cb14-06fe-43d7-9e67-3475c8ac2d23 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:28.657687 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9bb1cb14-06fe-43d7-9e67-3475c8ac2d23 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:28.658883 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9bb1cb14-06fe-43d7-9e67-3475c8ac2d23 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:28.659518 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9bb1cb14-06fe-43d7-9e67-3475c8ac2d23 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:28.796729 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-9bb1cb14-06fe-43d7-9e67-3475c8ac2d23 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:28.804756 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-9bb1cb14-06fe-43d7-9e67-3475c8ac2d23 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1522 microversion: 2.1 time: 0.162364 Aug 27 04:33:28.805337 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 186/379] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:33:28 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:29.533793 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-a308c277-9501-4e8f-a2e3-04236b99e7e4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:29.534811 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-a308c277-9501-4e8f-a2e3-04236b99e7e4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:29.541973 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a308c277-9501-4e8f-a2e3-04236b99e7e4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:29.542414 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a308c277-9501-4e8f-a2e3-04236b99e7e4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:29.543184 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a308c277-9501-4e8f-a2e3-04236b99e7e4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:29.543623 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a308c277-9501-4e8f-a2e3-04236b99e7e4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:29.618075 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-5dc2abc0-4656-4b7f-a590-1609f756aa01 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:29.619083 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-5dc2abc0-4656-4b7f-a590-1609f756aa01 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:29.625576 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5dc2abc0-4656-4b7f-a590-1609f756aa01 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:29.626196 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5dc2abc0-4656-4b7f-a590-1609f756aa01 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:29.627201 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5dc2abc0-4656-4b7f-a590-1609f756aa01 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:29.627760 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5dc2abc0-4656-4b7f-a590-1609f756aa01 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:29.642441 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-a308c277-9501-4e8f-a2e3-04236b99e7e4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28584 microversion: 2.20 time: 0.112467 Aug 27 04:33:29.643100 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 194/380] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:33:29 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28584 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:33:29.745549 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-5dc2abc0-4656-4b7f-a590-1609f756aa01 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28642 microversion: 2.1 time: 0.131249 Aug 27 04:33:29.746251 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 187/381] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:33:29 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28642 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:33:29.823041 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-5f299ba2-8c44-49b4-ace2-4d0155642e1e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:29.823764 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-5f299ba2-8c44-49b4-ace2-4d0155642e1e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:29.830298 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5f299ba2-8c44-49b4-ace2-4d0155642e1e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:29.830739 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5f299ba2-8c44-49b4-ace2-4d0155642e1e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:29.831497 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5f299ba2-8c44-49b4-ace2-4d0155642e1e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:29.831928 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5f299ba2-8c44-49b4-ace2-4d0155642e1e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:29.967686 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-5f299ba2-8c44-49b4-ace2-4d0155642e1e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:29.972992 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-5f299ba2-8c44-49b4-ace2-4d0155642e1e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1522 microversion: 2.1 time: 0.154533 Aug 27 04:33:29.973662 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 195/382] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:33:29 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:30.656118 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-4e915a2a-eb35-4e0e-aef3-0bbc8982e418 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:30.657032 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-4e915a2a-eb35-4e0e-aef3-0bbc8982e418 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:30.664294 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4e915a2a-eb35-4e0e-aef3-0bbc8982e418 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:30.664745 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4e915a2a-eb35-4e0e-aef3-0bbc8982e418 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:30.665520 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4e915a2a-eb35-4e0e-aef3-0bbc8982e418 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:30.665955 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4e915a2a-eb35-4e0e-aef3-0bbc8982e418 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:30.757529 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-eeb9dc7c-3cf7-4267-855f-af749156481a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:30.758442 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-eeb9dc7c-3cf7-4267-855f-af749156481a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:30.764470 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-eeb9dc7c-3cf7-4267-855f-af749156481a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:30.764918 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-eeb9dc7c-3cf7-4267-855f-af749156481a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:30.765729 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-eeb9dc7c-3cf7-4267-855f-af749156481a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:30.766163 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-eeb9dc7c-3cf7-4267-855f-af749156481a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:34.527475 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-4e915a2a-eb35-4e0e-aef3-0bbc8982e418 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28584 microversion: 2.20 time: 3.875422 Aug 27 04:33:34.528414 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 188/383] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:33:30 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28584 bytes in 3878 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:33:34.533353 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-1f770e30-34cc-49ee-9446-9a7f79bedb9d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:34.534041 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-1f770e30-34cc-49ee-9446-9a7f79bedb9d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:34.541157 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1f770e30-34cc-49ee-9446-9a7f79bedb9d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:34.541604 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1f770e30-34cc-49ee-9446-9a7f79bedb9d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:34.542373 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1f770e30-34cc-49ee-9446-9a7f79bedb9d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:34.542802 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1f770e30-34cc-49ee-9446-9a7f79bedb9d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:34.551417 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-eeb9dc7c-3cf7-4267-855f-af749156481a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28642 microversion: 2.1 time: 3.797412 Aug 27 04:33:34.552965 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 196/384] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:33:30 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28642 bytes in 3799 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:33:34.666713 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-1f770e30-34cc-49ee-9446-9a7f79bedb9d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:34.674215 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-1f770e30-34cc-49ee-9446-9a7f79bedb9d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1522 microversion: 2.1 time: 0.144638 Aug 27 04:33:34.674793 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 189/385] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:33:34 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:35.539696 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-3015f9fc-1fed-49d8-bc07-fc044bf5b333 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:35.540712 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-3015f9fc-1fed-49d8-bc07-fc044bf5b333 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:35.547287 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3015f9fc-1fed-49d8-bc07-fc044bf5b333 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:35.547733 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3015f9fc-1fed-49d8-bc07-fc044bf5b333 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:35.548551 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3015f9fc-1fed-49d8-bc07-fc044bf5b333 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:35.548989 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3015f9fc-1fed-49d8-bc07-fc044bf5b333 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:35.562761 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-8bc8b78c-fc77-4cee-8818-8fbb6b8bc7d0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:35.563669 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-8bc8b78c-fc77-4cee-8818-8fbb6b8bc7d0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:35.570745 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-8bc8b78c-fc77-4cee-8818-8fbb6b8bc7d0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:35.571208 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-8bc8b78c-fc77-4cee-8818-8fbb6b8bc7d0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:35.572021 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-8bc8b78c-fc77-4cee-8818-8fbb6b8bc7d0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:35.572466 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-8bc8b78c-fc77-4cee-8818-8fbb6b8bc7d0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:39.737449 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-3015f9fc-1fed-49d8-bc07-fc044bf5b333 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28584 microversion: 2.20 time: 4.201665 Aug 27 04:33:39.742143 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 197/386] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:33:35 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28584 bytes in 4203 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:33:39.743877 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-b4ff13ec-7b5a-4f64-9972-de9b13b8e135 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:39.744601 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-b4ff13ec-7b5a-4f64-9972-de9b13b8e135 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:39.751765 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b4ff13ec-7b5a-4f64-9972-de9b13b8e135 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:39.752221 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b4ff13ec-7b5a-4f64-9972-de9b13b8e135 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:39.752801 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-8bc8b78c-fc77-4cee-8818-8fbb6b8bc7d0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28642 microversion: 2.1 time: 4.193445 Aug 27 04:33:39.753263 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b4ff13ec-7b5a-4f64-9972-de9b13b8e135 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:39.753427 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b4ff13ec-7b5a-4f64-9972-de9b13b8e135 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:39.753544 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 190/387] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:33:35 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28642 bytes in 4195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:33:39.877654 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-b4ff13ec-7b5a-4f64-9972-de9b13b8e135 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:39.885138 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-b4ff13ec-7b5a-4f64-9972-de9b13b8e135 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1522 microversion: 2.1 time: 0.145808 Aug 27 04:33:39.885626 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 198/388] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:33:39 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:40.750079 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-37987a89-5676-4e0e-996e-d3c3ba134760 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:40.751099 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-37987a89-5676-4e0e-996e-d3c3ba134760 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:40.758217 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-37987a89-5676-4e0e-996e-d3c3ba134760 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:40.758790 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-37987a89-5676-4e0e-996e-d3c3ba134760 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:40.759427 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-37987a89-5676-4e0e-996e-d3c3ba134760 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:40.759867 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-37987a89-5676-4e0e-996e-d3c3ba134760 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:40.764270 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-02cde658-72c7-402d-8bd9-c744d0c14b83 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:40.765174 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-02cde658-72c7-402d-8bd9-c744d0c14b83 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:40.771312 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-02cde658-72c7-402d-8bd9-c744d0c14b83 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:40.771751 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-02cde658-72c7-402d-8bd9-c744d0c14b83 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:40.772548 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-02cde658-72c7-402d-8bd9-c744d0c14b83 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:40.772971 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-02cde658-72c7-402d-8bd9-c744d0c14b83 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:40.860816 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-37987a89-5676-4e0e-996e-d3c3ba134760 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28584 microversion: 2.20 time: 0.114602 Aug 27 04:33:40.861758 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 191/389] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:33:40 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28584 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:33:40.902737 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-f7bdcdc8-2314-4999-aecd-2baceb58bf1d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:40.903439 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-f7bdcdc8-2314-4999-aecd-2baceb58bf1d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:40.905004 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-02cde658-72c7-402d-8bd9-c744d0c14b83 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28642 microversion: 2.1 time: 0.144213 Aug 27 04:33:40.906450 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 199/390] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:33:40 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28642 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:33:40.910117 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f7bdcdc8-2314-4999-aecd-2baceb58bf1d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:40.910569 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f7bdcdc8-2314-4999-aecd-2baceb58bf1d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:40.911348 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f7bdcdc8-2314-4999-aecd-2baceb58bf1d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:40.912593 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f7bdcdc8-2314-4999-aecd-2baceb58bf1d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:41.034865 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-f7bdcdc8-2314-4999-aecd-2baceb58bf1d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:41.043054 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-f7bdcdc8-2314-4999-aecd-2baceb58bf1d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1522 microversion: 2.1 time: 0.144662 Aug 27 04:33:41.043618 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 192/391] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:33:40 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:33:41.873282 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-8edde4e4-7d95-49ff-8a8b-bd7720f3ac8e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:41.874276 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-8edde4e4-7d95-49ff-8a8b-bd7720f3ac8e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:41.881323 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8edde4e4-7d95-49ff-8a8b-bd7720f3ac8e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:41.881771 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8edde4e4-7d95-49ff-8a8b-bd7720f3ac8e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:41.882526 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8edde4e4-7d95-49ff-8a8b-bd7720f3ac8e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:41.882958 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8edde4e4-7d95-49ff-8a8b-bd7720f3ac8e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:41.916475 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-77c2d743-e6d1-4968-8f2b-24183de1c9ed tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:41.917411 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-77c2d743-e6d1-4968-8f2b-24183de1c9ed tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:41.923682 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-77c2d743-e6d1-4968-8f2b-24183de1c9ed tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:41.924171 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-77c2d743-e6d1-4968-8f2b-24183de1c9ed tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:41.924966 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-77c2d743-e6d1-4968-8f2b-24183de1c9ed tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:41.925400 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-77c2d743-e6d1-4968-8f2b-24183de1c9ed tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:41.981372 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-8edde4e4-7d95-49ff-8a8b-bd7720f3ac8e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28584 microversion: 2.20 time: 0.111957 Aug 27 04:33:41.982168 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 200/392] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:33:41 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28584 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:33:42.040226 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-77c2d743-e6d1-4968-8f2b-24183de1c9ed tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28642 microversion: 2.1 time: 0.127159 Aug 27 04:33:42.040881 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 193/393] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:33:41 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28642 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:33:42.060683 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-acbeebef-6d03-47df-b24e-863eaa08fa0f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:42.061414 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-acbeebef-6d03-47df-b24e-863eaa08fa0f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:42.068637 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-acbeebef-6d03-47df-b24e-863eaa08fa0f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:42.069004 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-acbeebef-6d03-47df-b24e-863eaa08fa0f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:42.069768 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-acbeebef-6d03-47df-b24e-863eaa08fa0f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:42.070204 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-acbeebef-6d03-47df-b24e-863eaa08fa0f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:42.189044 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-acbeebef-6d03-47df-b24e-863eaa08fa0f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:42.196696 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-acbeebef-6d03-47df-b24e-863eaa08fa0f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1522 microversion: 2.1 time: 0.139890 Aug 27 04:33:42.197254 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 201/394] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:33:42 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1522 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:42.993789 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-86d8514f-46d9-4ef2-b73d-1153d8976e04 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:42.994803 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-86d8514f-46d9-4ef2-b73d-1153d8976e04 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:43.001456 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-86d8514f-46d9-4ef2-b73d-1153d8976e04 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:43.001909 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-86d8514f-46d9-4ef2-b73d-1153d8976e04 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:43.002688 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-86d8514f-46d9-4ef2-b73d-1153d8976e04 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:43.003131 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-86d8514f-46d9-4ef2-b73d-1153d8976e04 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:43.050786 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-0f9d669a-dd38-4b42-9091-313103934ab9 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:43.051642 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-0f9d669a-dd38-4b42-9091-313103934ab9 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:43.057730 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0f9d669a-dd38-4b42-9091-313103934ab9 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:43.058169 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0f9d669a-dd38-4b42-9091-313103934ab9 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:43.058942 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0f9d669a-dd38-4b42-9091-313103934ab9 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:43.059490 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0f9d669a-dd38-4b42-9091-313103934ab9 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:43.134641 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-86d8514f-46d9-4ef2-b73d-1153d8976e04 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28584 microversion: 2.20 time: 0.145154 Aug 27 04:33:43.135325 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 194/395] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:33:42 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28584 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:33:43.164175 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-0f9d669a-dd38-4b42-9091-313103934ab9 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28642 microversion: 2.1 time: 0.116870 Aug 27 04:33:43.165071 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 202/396] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:33:43 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28642 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:33:43.214948 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-9a9d0a5c-4d35-447b-a0b8-b997cf31cb2e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:43.215657 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-9a9d0a5c-4d35-447b-a0b8-b997cf31cb2e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:43.222614 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9a9d0a5c-4d35-447b-a0b8-b997cf31cb2e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:43.223115 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9a9d0a5c-4d35-447b-a0b8-b997cf31cb2e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:43.224589 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9a9d0a5c-4d35-447b-a0b8-b997cf31cb2e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:43.225037 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9a9d0a5c-4d35-447b-a0b8-b997cf31cb2e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:43.355817 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-9a9d0a5c-4d35-447b-a0b8-b997cf31cb2e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:43.364966 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-9a9d0a5c-4d35-447b-a0b8-b997cf31cb2e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1522 microversion: 2.1 time: 0.154168 Aug 27 04:33:43.365585 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 195/397] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:33:43 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:44.146538 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-eaaa60e8-746d-4842-9e9f-41dc9745f310 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:44.147522 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-eaaa60e8-746d-4842-9e9f-41dc9745f310 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:44.153979 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-eaaa60e8-746d-4842-9e9f-41dc9745f310 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:44.154420 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-eaaa60e8-746d-4842-9e9f-41dc9745f310 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:44.155170 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-eaaa60e8-746d-4842-9e9f-41dc9745f310 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:44.155595 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-eaaa60e8-746d-4842-9e9f-41dc9745f310 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:44.175836 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-bdbf4974-00ee-410e-8909-6d260dd34d45 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:44.176911 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-bdbf4974-00ee-410e-8909-6d260dd34d45 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:44.183195 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-bdbf4974-00ee-410e-8909-6d260dd34d45 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:44.183647 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-bdbf4974-00ee-410e-8909-6d260dd34d45 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:44.184439 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-bdbf4974-00ee-410e-8909-6d260dd34d45 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:44.184879 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-bdbf4974-00ee-410e-8909-6d260dd34d45 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:44.276371 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-eaaa60e8-746d-4842-9e9f-41dc9745f310 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28584 microversion: 2.20 time: 0.133594 Aug 27 04:33:44.277074 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 203/398] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:33:44 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28584 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:33:44.313437 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-bdbf4974-00ee-410e-8909-6d260dd34d45 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28642 microversion: 2.1 time: 0.141038 Aug 27 04:33:44.314072 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 196/399] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:33:44 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28642 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:33:44.383177 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-82b49767-b8d8-4aa0-b7e7-9e724bf1d680 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:44.383913 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-82b49767-b8d8-4aa0-b7e7-9e724bf1d680 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:44.390344 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-82b49767-b8d8-4aa0-b7e7-9e724bf1d680 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:44.390792 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-82b49767-b8d8-4aa0-b7e7-9e724bf1d680 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:44.391611 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-82b49767-b8d8-4aa0-b7e7-9e724bf1d680 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:44.392070 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-82b49767-b8d8-4aa0-b7e7-9e724bf1d680 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:44.527027 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-82b49767-b8d8-4aa0-b7e7-9e724bf1d680 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:44.534288 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-82b49767-b8d8-4aa0-b7e7-9e724bf1d680 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1522 microversion: 2.1 time: 0.155285 Aug 27 04:33:44.534839 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 204/400] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:33:44 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:45.289362 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-423ebe94-b03d-40ef-9548-25202ca3b2f0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:45.290390 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-423ebe94-b03d-40ef-9548-25202ca3b2f0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:45.297146 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-423ebe94-b03d-40ef-9548-25202ca3b2f0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:45.297610 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-423ebe94-b03d-40ef-9548-25202ca3b2f0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:45.298375 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-423ebe94-b03d-40ef-9548-25202ca3b2f0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:45.298815 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-423ebe94-b03d-40ef-9548-25202ca3b2f0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:45.324731 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-400857c0-bced-4960-8408-3e07d308e74b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:45.325653 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-400857c0-bced-4960-8408-3e07d308e74b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:45.331375 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-400857c0-bced-4960-8408-3e07d308e74b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:45.331812 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-400857c0-bced-4960-8408-3e07d308e74b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:45.332598 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-400857c0-bced-4960-8408-3e07d308e74b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:45.333028 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-400857c0-bced-4960-8408-3e07d308e74b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:45.432456 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-423ebe94-b03d-40ef-9548-25202ca3b2f0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28584 microversion: 2.20 time: 0.147640 Aug 27 04:33:45.433166 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 197/401] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:33:45 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28584 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:33:45.461615 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-400857c0-bced-4960-8408-3e07d308e74b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28642 microversion: 2.1 time: 0.140265 Aug 27 04:33:45.462255 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 205/402] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:33:45 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28642 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:33:45.552105 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-0bdc2f24-7a03-4b4f-93c4-6321a38f13bf tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:45.552827 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-0bdc2f24-7a03-4b4f-93c4-6321a38f13bf tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:45.559136 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0bdc2f24-7a03-4b4f-93c4-6321a38f13bf tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:45.559586 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0bdc2f24-7a03-4b4f-93c4-6321a38f13bf tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:45.560380 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0bdc2f24-7a03-4b4f-93c4-6321a38f13bf tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:45.560822 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0bdc2f24-7a03-4b4f-93c4-6321a38f13bf tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:45.683131 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-0bdc2f24-7a03-4b4f-93c4-6321a38f13bf tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:45.690363 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-0bdc2f24-7a03-4b4f-93c4-6321a38f13bf tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1522 microversion: 2.1 time: 0.142329 Aug 27 04:33:45.690919 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 198/403] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:33:45 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1522 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:46.445087 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-ae9daca6-e0ec-4f9b-8648-581cdc365162 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:46.446160 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-ae9daca6-e0ec-4f9b-8648-581cdc365162 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:46.453177 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ae9daca6-e0ec-4f9b-8648-581cdc365162 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:46.453672 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ae9daca6-e0ec-4f9b-8648-581cdc365162 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:46.454460 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ae9daca6-e0ec-4f9b-8648-581cdc365162 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:46.454895 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ae9daca6-e0ec-4f9b-8648-581cdc365162 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:46.472638 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-968372b2-b77c-448e-9463-5b97516688dd tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:46.473572 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-968372b2-b77c-448e-9463-5b97516688dd tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:46.480192 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-968372b2-b77c-448e-9463-5b97516688dd tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:46.480713 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-968372b2-b77c-448e-9463-5b97516688dd tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:46.481474 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-968372b2-b77c-448e-9463-5b97516688dd tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:46.481911 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-968372b2-b77c-448e-9463-5b97516688dd tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:46.579228 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-ae9daca6-e0ec-4f9b-8648-581cdc365162 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28584 microversion: 2.20 time: 0.138217 Aug 27 04:33:46.580062 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 206/404] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:33:46 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28584 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:33:46.598334 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-968372b2-b77c-448e-9463-5b97516688dd tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28642 microversion: 2.1 time: 0.129304 Aug 27 04:33:46.599545 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 199/405] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:33:46 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28642 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:33:46.708241 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-86eaa56c-6197-4562-afed-bfbb2380bf4c tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:46.708994 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-86eaa56c-6197-4562-afed-bfbb2380bf4c tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:46.715437 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-86eaa56c-6197-4562-afed-bfbb2380bf4c tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:46.715884 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-86eaa56c-6197-4562-afed-bfbb2380bf4c tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:46.716684 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-86eaa56c-6197-4562-afed-bfbb2380bf4c tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:46.717115 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-86eaa56c-6197-4562-afed-bfbb2380bf4c tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:46.857831 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-86eaa56c-6197-4562-afed-bfbb2380bf4c tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:46.866063 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-86eaa56c-6197-4562-afed-bfbb2380bf4c tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1522 microversion: 2.1 time: 0.161805 Aug 27 04:33:46.866641 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 207/406] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:33:46 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:47.591920 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-67de3291-4bb2-4478-bd25-e22b32d56c14 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:47.592956 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-67de3291-4bb2-4478-bd25-e22b32d56c14 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:47.600308 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-67de3291-4bb2-4478-bd25-e22b32d56c14 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:47.600466 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-67de3291-4bb2-4478-bd25-e22b32d56c14 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:47.601224 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-67de3291-4bb2-4478-bd25-e22b32d56c14 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:47.601660 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-67de3291-4bb2-4478-bd25-e22b32d56c14 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:47.610592 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-23b817a7-cc3b-43fd-8a28-951a7491f06e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:47.612450 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-23b817a7-cc3b-43fd-8a28-951a7491f06e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:47.619801 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-23b817a7-cc3b-43fd-8a28-951a7491f06e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:47.620534 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-23b817a7-cc3b-43fd-8a28-951a7491f06e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:47.621526 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-23b817a7-cc3b-43fd-8a28-951a7491f06e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:47.621956 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-23b817a7-cc3b-43fd-8a28-951a7491f06e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:47.743115 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-67de3291-4bb2-4478-bd25-e22b32d56c14 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28584 microversion: 2.20 time: 0.155115 Aug 27 04:33:47.744597 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 200/407] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:33:47 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28584 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:33:47.884898 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-35d4efe8-d3d8-40e5-892e-08a6f4ed2a3d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:47.885591 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-35d4efe8-d3d8-40e5-892e-08a6f4ed2a3d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:47.892743 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-35d4efe8-d3d8-40e5-892e-08a6f4ed2a3d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:47.893197 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-35d4efe8-d3d8-40e5-892e-08a6f4ed2a3d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:47.893989 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-35d4efe8-d3d8-40e5-892e-08a6f4ed2a3d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:47.894434 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-35d4efe8-d3d8-40e5-892e-08a6f4ed2a3d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:48.054525 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-35d4efe8-d3d8-40e5-892e-08a6f4ed2a3d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:48.062209 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-35d4efe8-d3d8-40e5-892e-08a6f4ed2a3d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1522 microversion: 2.1 time: 0.181279 Aug 27 04:33:48.062873 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 201/408] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:33:47 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:33:48.206017 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-23b817a7-cc3b-43fd-8a28-951a7491f06e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28642 microversion: 2.1 time: 0.598871 Aug 27 04:33:48.208523 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 208/409] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:33:47 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28642 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:33:48.754153 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-099f3509-b499-4a18-aa68-556fd87ccd78 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:48.755284 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-099f3509-b499-4a18-aa68-556fd87ccd78 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:48.761320 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-099f3509-b499-4a18-aa68-556fd87ccd78 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:48.761763 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-099f3509-b499-4a18-aa68-556fd87ccd78 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:48.762541 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-099f3509-b499-4a18-aa68-556fd87ccd78 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:48.762966 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-099f3509-b499-4a18-aa68-556fd87ccd78 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:48.866619 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-099f3509-b499-4a18-aa68-556fd87ccd78 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28584 microversion: 2.20 time: 0.116068 Aug 27 04:33:48.870957 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 202/410] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:33:48 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28584 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:33:49.079117 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-1088f3af-c3c4-48c7-b4f4-571d36838eec tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:49.079886 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-1088f3af-c3c4-48c7-b4f4-571d36838eec tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:49.087444 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1088f3af-c3c4-48c7-b4f4-571d36838eec tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:49.087890 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1088f3af-c3c4-48c7-b4f4-571d36838eec tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:49.088702 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1088f3af-c3c4-48c7-b4f4-571d36838eec tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:49.089308 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1088f3af-c3c4-48c7-b4f4-571d36838eec tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:49.217418 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-1088f3af-c3c4-48c7-b4f4-571d36838eec tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:49.218332 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-19f1eb53-fc8f-4633-adfb-88d9475a02bb tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:49.219340 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-19f1eb53-fc8f-4633-adfb-88d9475a02bb tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:49.225842 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-1088f3af-c3c4-48c7-b4f4-571d36838eec tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1522 microversion: 2.1 time: 0.150699 Aug 27 04:33:49.226760 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 209/411] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:33:49 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:49.237363 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-19f1eb53-fc8f-4633-adfb-88d9475a02bb tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:49.237821 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-19f1eb53-fc8f-4633-adfb-88d9475a02bb tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:49.238608 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-19f1eb53-fc8f-4633-adfb-88d9475a02bb tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:49.239047 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-19f1eb53-fc8f-4633-adfb-88d9475a02bb tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:49.381703 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-19f1eb53-fc8f-4633-adfb-88d9475a02bb tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28642 microversion: 2.1 time: 0.167501 Aug 27 04:33:49.382355 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 203/412] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:33:49 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28642 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:33:49.878742 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-af929893-8497-493f-986f-1ed26dbb0f17 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:49.879663 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-af929893-8497-493f-986f-1ed26dbb0f17 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:49.886373 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-af929893-8497-493f-986f-1ed26dbb0f17 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:49.886812 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-af929893-8497-493f-986f-1ed26dbb0f17 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:49.887579 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-af929893-8497-493f-986f-1ed26dbb0f17 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:49.888031 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-af929893-8497-493f-986f-1ed26dbb0f17 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:49.996865 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-af929893-8497-493f-986f-1ed26dbb0f17 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28584 microversion: 2.20 time: 0.121564 Aug 27 04:33:49.997664 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 210/413] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:33:49 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28584 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:33:50.244451 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-1c22daef-f544-4ca9-b8ff-b86e95cc18ae tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:50.245291 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-1c22daef-f544-4ca9-b8ff-b86e95cc18ae tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:50.253755 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1c22daef-f544-4ca9-b8ff-b86e95cc18ae tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:50.254348 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1c22daef-f544-4ca9-b8ff-b86e95cc18ae tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:50.255089 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1c22daef-f544-4ca9-b8ff-b86e95cc18ae tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:50.255889 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1c22daef-f544-4ca9-b8ff-b86e95cc18ae tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:50.386911 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-1c22daef-f544-4ca9-b8ff-b86e95cc18ae tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:50.394598 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-0e3962f8-364e-44f3-b29c-447e2d19826d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:50.395156 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-1c22daef-f544-4ca9-b8ff-b86e95cc18ae tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1502 microversion: 2.1 time: 0.156009 Aug 27 04:33:50.396082 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 204/414] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:33:50 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1502 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:50.397229 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-0e3962f8-364e-44f3-b29c-447e2d19826d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:50.403873 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0e3962f8-364e-44f3-b29c-447e2d19826d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:50.404553 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0e3962f8-364e-44f3-b29c-447e2d19826d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:50.405567 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0e3962f8-364e-44f3-b29c-447e2d19826d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:50.406033 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0e3962f8-364e-44f3-b29c-447e2d19826d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:50.412252 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-29f32a5f-2297-443f-813f-c71b7430ebce tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:50.412770 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-29f32a5f-2297-443f-813f-c71b7430ebce tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:50.418787 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-29f32a5f-2297-443f-813f-c71b7430ebce tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:50.419198 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-29f32a5f-2297-443f-813f-c71b7430ebce tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:50.420200 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-29f32a5f-2297-443f-813f-c71b7430ebce tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:50.420624 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-29f32a5f-2297-443f-813f-c71b7430ebce tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:50.530623 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-0e3962f8-364e-44f3-b29c-447e2d19826d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28642 microversion: 2.1 time: 0.139817 Aug 27 04:33:50.531339 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 211/415] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:33:50 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28642 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:33:50.554872 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-29f32a5f-2297-443f-813f-c71b7430ebce tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:50.562930 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-29f32a5f-2297-443f-813f-c71b7430ebce tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1515 microversion: 2.1 time: 0.155213 Aug 27 04:33:50.563516 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 205/416] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:33:50 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:33:51.010254 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-b3aad835-d862-4371-a915-66968e51f53f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:51.011337 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-b3aad835-d862-4371-a915-66968e51f53f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:51.017751 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b3aad835-d862-4371-a915-66968e51f53f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:51.018190 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b3aad835-d862-4371-a915-66968e51f53f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:51.019041 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b3aad835-d862-4371-a915-66968e51f53f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:51.019468 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b3aad835-d862-4371-a915-66968e51f53f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:51.139185 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-b3aad835-d862-4371-a915-66968e51f53f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28584 microversion: 2.20 time: 0.133076 Aug 27 04:33:51.144917 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 212/417] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:33:51 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28584 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:33:51.547928 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-3c52024a-6444-4539-84e1-3fae1ab42e71 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:51.550175 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-3c52024a-6444-4539-84e1-3fae1ab42e71 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:51.558728 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3c52024a-6444-4539-84e1-3fae1ab42e71 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:51.559461 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3c52024a-6444-4539-84e1-3fae1ab42e71 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:51.560796 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3c52024a-6444-4539-84e1-3fae1ab42e71 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:51.562090 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3c52024a-6444-4539-84e1-3fae1ab42e71 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:51.668010 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-3c52024a-6444-4539-84e1-3fae1ab42e71 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28642 microversion: 2.1 time: 0.125564 Aug 27 04:33:51.672009 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 206/418] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:33:51 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28642 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:33:52.152110 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-0f3f3a2d-d84b-4c3c-ab7d-00c1c333d3e9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:52.154412 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-0f3f3a2d-d84b-4c3c-ab7d-00c1c333d3e9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:52.160980 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0f3f3a2d-d84b-4c3c-ab7d-00c1c333d3e9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:52.161671 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0f3f3a2d-d84b-4c3c-ab7d-00c1c333d3e9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:52.162459 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0f3f3a2d-d84b-4c3c-ab7d-00c1c333d3e9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:52.162893 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0f3f3a2d-d84b-4c3c-ab7d-00c1c333d3e9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:52.254582 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-0f3f3a2d-d84b-4c3c-ab7d-00c1c333d3e9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28584 microversion: 2.20 time: 0.106530 Aug 27 04:33:52.256942 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 213/419] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:33:52 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28584 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:33:52.680184 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-4295871d-7771-4390-a42a-9d922538b296 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:52.682294 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-4295871d-7771-4390-a42a-9d922538b296 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:52.694846 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4295871d-7771-4390-a42a-9d922538b296 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:52.695620 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4295871d-7771-4390-a42a-9d922538b296 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:52.696714 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4295871d-7771-4390-a42a-9d922538b296 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:52.697395 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4295871d-7771-4390-a42a-9d922538b296 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:52.806038 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-4295871d-7771-4390-a42a-9d922538b296 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28642 microversion: 2.1 time: 0.130650 Aug 27 04:33:52.807335 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 207/420] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:33:52 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28642 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:33:53.090381 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-9ee853e7-6ac9-414e-8dd6-b268a76a51db tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:53.091591 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-9ee853e7-6ac9-414e-8dd6-b268a76a51db tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:53.103524 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9ee853e7-6ac9-414e-8dd6-b268a76a51db tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:53.103979 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9ee853e7-6ac9-414e-8dd6-b268a76a51db tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:53.104859 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9ee853e7-6ac9-414e-8dd6-b268a76a51db tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:53.105335 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9ee853e7-6ac9-414e-8dd6-b268a76a51db tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:53.169400 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.objects.instance [None req-9ee853e7-6ac9-414e-8dd6-b268a76a51db tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lazy-loading 'flavor' on Instance uuid 0e594817-f3cc-40e6-babe-c736641fb9a9 {{(pid=108971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:33:53.268956 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-d09f9f5a-0f7a-44d1-a535-2a8d06723b9b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:53.270460 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-d09f9f5a-0f7a-44d1-a535-2a8d06723b9b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:53.295926 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d09f9f5a-0f7a-44d1-a535-2a8d06723b9b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:53.296540 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d09f9f5a-0f7a-44d1-a535-2a8d06723b9b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:53.297526 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d09f9f5a-0f7a-44d1-a535-2a8d06723b9b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:53.297975 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d09f9f5a-0f7a-44d1-a535-2a8d06723b9b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:53.357416 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-9ee853e7-6ac9-414e-8dd6-b268a76a51db tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "POST /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9/action" status: 200 len: 32 microversion: 2.1 time: 0.268790 Aug 27 04:33:53.358306 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 214/421] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:33:53 2021] POST /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9/action => generated 32 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:33:53.374546 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-7e200d90-cdf3-4dc2-8926-40d0b63d595c tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:53.376941 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-7e200d90-cdf3-4dc2-8926-40d0b63d595c tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:53.393679 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7e200d90-cdf3-4dc2-8926-40d0b63d595c tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:53.396212 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7e200d90-cdf3-4dc2-8926-40d0b63d595c tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:53.397891 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7e200d90-cdf3-4dc2-8926-40d0b63d595c tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:53.398631 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7e200d90-cdf3-4dc2-8926-40d0b63d595c tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:53.496804 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-d09f9f5a-0f7a-44d1-a535-2a8d06723b9b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28584 microversion: 2.20 time: 0.233060 Aug 27 04:33:53.498886 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 208/422] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:33:53 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28584 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:33:53.732380 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-7e200d90-cdf3-4dc2-8926-40d0b63d595c tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:53.750736 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-7e200d90-cdf3-4dc2-8926-40d0b63d595c tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1521 microversion: 2.1 time: 0.385062 Aug 27 04:33:53.752191 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 215/423] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:33:53 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1521 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:53.820011 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-1d742d9f-060d-4f4e-b0ca-87937dbaa236 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:53.820678 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-1d742d9f-060d-4f4e-b0ca-87937dbaa236 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:53.841873 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1d742d9f-060d-4f4e-b0ca-87937dbaa236 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:53.842930 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1d742d9f-060d-4f4e-b0ca-87937dbaa236 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:53.844211 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1d742d9f-060d-4f4e-b0ca-87937dbaa236 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:53.846100 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1d742d9f-060d-4f4e-b0ca-87937dbaa236 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:53.960901 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-1d742d9f-060d-4f4e-b0ca-87937dbaa236 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28642 microversion: 2.1 time: 0.146435 Aug 27 04:33:53.963162 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 209/424] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:33:53 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28642 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:33:54.522213 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-3c1e35fa-6512-4f3e-87dc-9e1bd6147dd7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:54.523344 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-3c1e35fa-6512-4f3e-87dc-9e1bd6147dd7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:54.530212 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3c1e35fa-6512-4f3e-87dc-9e1bd6147dd7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:54.530936 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3c1e35fa-6512-4f3e-87dc-9e1bd6147dd7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:54.531941 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3c1e35fa-6512-4f3e-87dc-9e1bd6147dd7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:54.532539 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3c1e35fa-6512-4f3e-87dc-9e1bd6147dd7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:54.673479 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-3c1e35fa-6512-4f3e-87dc-9e1bd6147dd7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28584 microversion: 2.20 time: 0.167529 Aug 27 04:33:54.674322 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 216/425] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:33:54 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28584 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:33:54.771402 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-fc0f83ab-397c-4bd2-8ce6-811a0569d233 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:54.772460 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-fc0f83ab-397c-4bd2-8ce6-811a0569d233 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:54.782868 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fc0f83ab-397c-4bd2-8ce6-811a0569d233 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:54.783958 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fc0f83ab-397c-4bd2-8ce6-811a0569d233 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:54.785161 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fc0f83ab-397c-4bd2-8ce6-811a0569d233 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:54.786215 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fc0f83ab-397c-4bd2-8ce6-811a0569d233 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:54.949598 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-fc0f83ab-397c-4bd2-8ce6-811a0569d233 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:54.957306 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-fc0f83ab-397c-4bd2-8ce6-811a0569d233 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1521 microversion: 2.1 time: 0.192281 Aug 27 04:33:54.957824 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 210/426] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:33:54 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:54.974263 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-20a8602d-349f-455e-bde0-d34a300fba53 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:54.975931 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-20a8602d-349f-455e-bde0-d34a300fba53 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:54.985983 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-20a8602d-349f-455e-bde0-d34a300fba53 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:54.986751 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-20a8602d-349f-455e-bde0-d34a300fba53 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:54.987740 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-20a8602d-349f-455e-bde0-d34a300fba53 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:54.988425 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-20a8602d-349f-455e-bde0-d34a300fba53 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:55.134473 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-20a8602d-349f-455e-bde0-d34a300fba53 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28642 microversion: 2.1 time: 0.164449 Aug 27 04:33:55.139578 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 217/427] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:33:54 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28642 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:33:55.692906 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-817c1f27-e953-4788-8a07-6633b2824322 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:55.693720 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-817c1f27-e953-4788-8a07-6633b2824322 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:55.700776 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-817c1f27-e953-4788-8a07-6633b2824322 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:55.701228 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-817c1f27-e953-4788-8a07-6633b2824322 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:55.702016 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-817c1f27-e953-4788-8a07-6633b2824322 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:55.702626 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-817c1f27-e953-4788-8a07-6633b2824322 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:55.821177 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-817c1f27-e953-4788-8a07-6633b2824322 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28584 microversion: 2.20 time: 0.138315 Aug 27 04:33:55.821817 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 211/428] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:33:55 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28584 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:33:55.977007 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-8d9b13fb-fff1-454f-a88c-9c378c1b46e1 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:55.978420 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-8d9b13fb-fff1-454f-a88c-9c378c1b46e1 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:55.985703 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8d9b13fb-fff1-454f-a88c-9c378c1b46e1 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:55.986306 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8d9b13fb-fff1-454f-a88c-9c378c1b46e1 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:55.987275 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8d9b13fb-fff1-454f-a88c-9c378c1b46e1 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:55.987714 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8d9b13fb-fff1-454f-a88c-9c378c1b46e1 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:56.149899 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-6ea11b82-1a25-4268-9757-c948f387d5f9 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:56.152734 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-6ea11b82-1a25-4268-9757-c948f387d5f9 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:56.160399 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6ea11b82-1a25-4268-9757-c948f387d5f9 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:56.161193 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6ea11b82-1a25-4268-9757-c948f387d5f9 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:56.162154 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6ea11b82-1a25-4268-9757-c948f387d5f9 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:56.162766 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6ea11b82-1a25-4268-9757-c948f387d5f9 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:56.289309 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-6ea11b82-1a25-4268-9757-c948f387d5f9 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28642 microversion: 2.1 time: 0.144874 Aug 27 04:33:56.290505 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 212/429] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:33:56 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28642 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:33:56.316121 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-8d9b13fb-fff1-454f-a88c-9c378c1b46e1 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:56.328931 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-8d9b13fb-fff1-454f-a88c-9c378c1b46e1 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1521 microversion: 2.1 time: 0.357907 Aug 27 04:33:56.329918 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 218/430] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:33:55 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1521 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:56.833647 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-660a3728-0e57-4671-84b8-f2ccc6b01eab tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:56.834636 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-660a3728-0e57-4671-84b8-f2ccc6b01eab tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:56.841305 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-660a3728-0e57-4671-84b8-f2ccc6b01eab tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:56.842012 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-660a3728-0e57-4671-84b8-f2ccc6b01eab tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:56.842810 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-660a3728-0e57-4671-84b8-f2ccc6b01eab tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:56.843253 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-660a3728-0e57-4671-84b8-f2ccc6b01eab tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:56.953471 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-660a3728-0e57-4671-84b8-f2ccc6b01eab tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28584 microversion: 2.20 time: 0.123990 Aug 27 04:33:56.954260 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 213/431] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:33:56 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28584 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:33:57.302005 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-94333b76-e928-4376-9160-db927007918b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:57.302933 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-94333b76-e928-4376-9160-db927007918b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:57.312419 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-94333b76-e928-4376-9160-db927007918b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:57.313503 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-94333b76-e928-4376-9160-db927007918b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:57.314794 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-94333b76-e928-4376-9160-db927007918b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:57.315590 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-94333b76-e928-4376-9160-db927007918b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:57.354995 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-43439f71-faca-45c6-93fe-7dba31043698 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:57.357273 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-43439f71-faca-45c6-93fe-7dba31043698 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:57.387264 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-43439f71-faca-45c6-93fe-7dba31043698 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:57.388193 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-43439f71-faca-45c6-93fe-7dba31043698 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:57.389253 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-43439f71-faca-45c6-93fe-7dba31043698 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:57.389922 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-43439f71-faca-45c6-93fe-7dba31043698 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:57.480369 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-94333b76-e928-4376-9160-db927007918b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28642 microversion: 2.1 time: 0.182432 Aug 27 04:33:57.481001 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 219/432] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:33:57 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28642 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:33:57.766778 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-43439f71-faca-45c6-93fe-7dba31043698 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:57.787895 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-43439f71-faca-45c6-93fe-7dba31043698 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1521 microversion: 2.1 time: 0.443475 Aug 27 04:33:57.788915 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 214/433] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:33:57 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1521 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:57.966855 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-2ed38e57-8958-4a00-b439-03a56c75d581 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:57.967880 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-2ed38e57-8958-4a00-b439-03a56c75d581 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:57.975925 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-2ed38e57-8958-4a00-b439-03a56c75d581 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:57.976820 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-2ed38e57-8958-4a00-b439-03a56c75d581 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:57.978211 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-2ed38e57-8958-4a00-b439-03a56c75d581 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:57.978942 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-2ed38e57-8958-4a00-b439-03a56c75d581 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:58.130795 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-2ed38e57-8958-4a00-b439-03a56c75d581 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28584 microversion: 2.20 time: 0.168857 Aug 27 04:33:58.131626 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 220/434] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:33:57 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28584 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:33:58.492099 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-a14783c4-c73d-4b34-ba45-957622bcad4b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:58.493699 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-a14783c4-c73d-4b34-ba45-957622bcad4b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:58.511400 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a14783c4-c73d-4b34-ba45-957622bcad4b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:58.511875 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a14783c4-c73d-4b34-ba45-957622bcad4b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:58.512739 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a14783c4-c73d-4b34-ba45-957622bcad4b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:58.513184 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a14783c4-c73d-4b34-ba45-957622bcad4b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:58.807548 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-77104f58-6c9d-4727-9a4d-f6f35549967d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:33:58.808385 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-77104f58-6c9d-4727-9a4d-f6f35549967d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:58.815800 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-77104f58-6c9d-4727-9a4d-f6f35549967d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:58.816271 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-77104f58-6c9d-4727-9a4d-f6f35549967d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:58.817071 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-77104f58-6c9d-4727-9a4d-f6f35549967d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:58.817754 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-77104f58-6c9d-4727-9a4d-f6f35549967d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:58.984816 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-77104f58-6c9d-4727-9a4d-f6f35549967d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:33:58.994989 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-77104f58-6c9d-4727-9a4d-f6f35549967d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1521 microversion: 2.1 time: 0.190887 Aug 27 04:33:58.995756 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 221/435] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:33:58 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:33:59.143830 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-aab576cd-d88f-4a83-8d90-05b46be0b5a3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:33:59.146558 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-aab576cd-d88f-4a83-8d90-05b46be0b5a3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:33:59.153538 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-aab576cd-d88f-4a83-8d90-05b46be0b5a3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:59.154059 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-aab576cd-d88f-4a83-8d90-05b46be0b5a3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:33:59.158155 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-aab576cd-d88f-4a83-8d90-05b46be0b5a3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:33:59.158669 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-aab576cd-d88f-4a83-8d90-05b46be0b5a3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:02.593634 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-a14783c4-c73d-4b34-ba45-957622bcad4b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28642 microversion: 2.1 time: 4.105243 Aug 27 04:34:02.599506 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 215/436] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:33:58 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28642 bytes in 4112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:34:02.606324 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-edd6fb2c-e357-4ab2-bd02-a8d9efa4f88c tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:02.607337 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-edd6fb2c-e357-4ab2-bd02-a8d9efa4f88c tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:02.617013 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-edd6fb2c-e357-4ab2-bd02-a8d9efa4f88c tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:02.617923 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-edd6fb2c-e357-4ab2-bd02-a8d9efa4f88c tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:02.619501 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-edd6fb2c-e357-4ab2-bd02-a8d9efa4f88c tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:02.620224 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-edd6fb2c-e357-4ab2-bd02-a8d9efa4f88c tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:02.622850 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-aab576cd-d88f-4a83-8d90-05b46be0b5a3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28584 microversion: 2.20 time: 3.482660 Aug 27 04:34:02.627815 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 222/437] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:33:59 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28584 bytes in 3488 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:34:02.774213 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-edd6fb2c-e357-4ab2-bd02-a8d9efa4f88c tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:02.784536 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-edd6fb2c-e357-4ab2-bd02-a8d9efa4f88c tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1521 microversion: 2.1 time: 0.183053 Aug 27 04:34:02.787209 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 216/438] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:34:02 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:03.614520 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-ed72775d-34ac-45cf-9fb0-15d36c78b4f0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:03.616420 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-ed72775d-34ac-45cf-9fb0-15d36c78b4f0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:03.626729 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ed72775d-34ac-45cf-9fb0-15d36c78b4f0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:03.628509 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ed72775d-34ac-45cf-9fb0-15d36c78b4f0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:03.630403 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ed72775d-34ac-45cf-9fb0-15d36c78b4f0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:03.631144 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ed72775d-34ac-45cf-9fb0-15d36c78b4f0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:03.639114 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-d6a5212c-2dc9-4f2d-9ae7-78e94c00cfce tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:03.641352 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-d6a5212c-2dc9-4f2d-9ae7-78e94c00cfce tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:03.656263 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d6a5212c-2dc9-4f2d-9ae7-78e94c00cfce tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:03.656927 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d6a5212c-2dc9-4f2d-9ae7-78e94c00cfce tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:03.657966 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d6a5212c-2dc9-4f2d-9ae7-78e94c00cfce tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:03.659098 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d6a5212c-2dc9-4f2d-9ae7-78e94c00cfce tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:03.779541 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-ed72775d-34ac-45cf-9fb0-15d36c78b4f0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28642 microversion: 2.1 time: 0.175993 Aug 27 04:34:03.784704 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 223/439] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:34:03 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28642 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:34:03.807498 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-79ae99eb-3987-4cdb-a65f-0768cbf7a99e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:03.809423 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-79ae99eb-3987-4cdb-a65f-0768cbf7a99e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:03.815487 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-d6a5212c-2dc9-4f2d-9ae7-78e94c00cfce tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28584 microversion: 2.20 time: 0.183525 Aug 27 04:34:03.816862 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 217/440] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:34:03 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28584 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:34:03.834851 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-79ae99eb-3987-4cdb-a65f-0768cbf7a99e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:03.835580 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-79ae99eb-3987-4cdb-a65f-0768cbf7a99e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:03.836584 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-79ae99eb-3987-4cdb-a65f-0768cbf7a99e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:03.837177 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-79ae99eb-3987-4cdb-a65f-0768cbf7a99e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:03.998300 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-79ae99eb-3987-4cdb-a65f-0768cbf7a99e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:04.009885 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-79ae99eb-3987-4cdb-a65f-0768cbf7a99e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1521 microversion: 2.1 time: 0.209346 Aug 27 04:34:04.019761 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 224/441] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:34:03 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:04.794496 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-0f177fbd-0fc4-4ac9-a49f-e32e46497192 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:04.796958 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-0f177fbd-0fc4-4ac9-a49f-e32e46497192 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:04.816510 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0f177fbd-0fc4-4ac9-a49f-e32e46497192 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:04.820952 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0f177fbd-0fc4-4ac9-a49f-e32e46497192 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:04.825277 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0f177fbd-0fc4-4ac9-a49f-e32e46497192 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:04.826799 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0f177fbd-0fc4-4ac9-a49f-e32e46497192 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:04.830293 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-c81cbd54-e743-4d58-a40b-7756a1396b5a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:04.831856 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-c81cbd54-e743-4d58-a40b-7756a1396b5a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:04.842804 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c81cbd54-e743-4d58-a40b-7756a1396b5a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:04.844396 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c81cbd54-e743-4d58-a40b-7756a1396b5a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:04.849129 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c81cbd54-e743-4d58-a40b-7756a1396b5a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:04.850371 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c81cbd54-e743-4d58-a40b-7756a1396b5a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:05.008206 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-0f177fbd-0fc4-4ac9-a49f-e32e46497192 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28642 microversion: 2.1 time: 0.218854 Aug 27 04:34:05.009362 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 218/442] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:34:04 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28642 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:34:05.040356 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-c81cbd54-e743-4d58-a40b-7756a1396b5a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28584 microversion: 2.20 time: 0.214515 Aug 27 04:34:05.041337 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 225/443] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:34:04 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28584 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:34:05.042146 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-1d0522ba-89a1-45c2-97b3-8f529286e711 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:05.043121 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-1d0522ba-89a1-45c2-97b3-8f529286e711 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:05.050858 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1d0522ba-89a1-45c2-97b3-8f529286e711 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:05.052323 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1d0522ba-89a1-45c2-97b3-8f529286e711 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:05.053417 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1d0522ba-89a1-45c2-97b3-8f529286e711 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:05.054080 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1d0522ba-89a1-45c2-97b3-8f529286e711 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:05.224965 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-1d0522ba-89a1-45c2-97b3-8f529286e711 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:05.239898 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-1d0522ba-89a1-45c2-97b3-8f529286e711 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1521 microversion: 2.1 time: 0.206059 Aug 27 04:34:05.241041 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 219/444] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:34:05 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:34:06.025504 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-5a6a5c14-cb13-4ba2-beeb-94b2b5d9d43f tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:06.027141 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-5a6a5c14-cb13-4ba2-beeb-94b2b5d9d43f tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:06.036436 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5a6a5c14-cb13-4ba2-beeb-94b2b5d9d43f tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:06.036879 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5a6a5c14-cb13-4ba2-beeb-94b2b5d9d43f tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:06.037706 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5a6a5c14-cb13-4ba2-beeb-94b2b5d9d43f tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:06.038140 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5a6a5c14-cb13-4ba2-beeb-94b2b5d9d43f tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:06.054162 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-02548615-7a3f-4905-9383-fd8c1a33cfc8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:06.055290 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-02548615-7a3f-4905-9383-fd8c1a33cfc8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:06.073844 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-02548615-7a3f-4905-9383-fd8c1a33cfc8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:06.074308 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-02548615-7a3f-4905-9383-fd8c1a33cfc8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:06.075122 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-02548615-7a3f-4905-9383-fd8c1a33cfc8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:06.075568 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-02548615-7a3f-4905-9383-fd8c1a33cfc8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:06.173268 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-5a6a5c14-cb13-4ba2-beeb-94b2b5d9d43f tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28642 microversion: 2.1 time: 0.151362 Aug 27 04:34:06.174256 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 226/445] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:34:06 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28642 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:34:06.251921 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-02548615-7a3f-4905-9383-fd8c1a33cfc8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28584 microversion: 2.20 time: 0.204129 Aug 27 04:34:06.256246 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 220/446] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:34:06 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28584 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:34:06.261287 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-cb1d750c-6f8a-4e3a-888d-12f13cef5d2b tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:06.262168 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-cb1d750c-6f8a-4e3a-888d-12f13cef5d2b tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:06.278902 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cb1d750c-6f8a-4e3a-888d-12f13cef5d2b tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:06.279372 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cb1d750c-6f8a-4e3a-888d-12f13cef5d2b tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:06.280263 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cb1d750c-6f8a-4e3a-888d-12f13cef5d2b tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:06.280696 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cb1d750c-6f8a-4e3a-888d-12f13cef5d2b tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:06.440647 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-cb1d750c-6f8a-4e3a-888d-12f13cef5d2b tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:06.448428 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-cb1d750c-6f8a-4e3a-888d-12f13cef5d2b tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1521 microversion: 2.1 time: 0.191170 Aug 27 04:34:06.449003 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 227/447] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:34:06 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:07.195753 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-78da8931-c8ca-4670-8fdf-f6f71c184273 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:07.197074 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-78da8931-c8ca-4670-8fdf-f6f71c184273 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:07.204054 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-78da8931-c8ca-4670-8fdf-f6f71c184273 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:07.204510 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-78da8931-c8ca-4670-8fdf-f6f71c184273 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:07.207012 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-78da8931-c8ca-4670-8fdf-f6f71c184273 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:07.208302 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-78da8931-c8ca-4670-8fdf-f6f71c184273 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:07.262856 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-b7e8d221-b456-477c-b27b-bf234785c2bf tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:07.263771 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-b7e8d221-b456-477c-b27b-bf234785c2bf tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:07.272898 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b7e8d221-b456-477c-b27b-bf234785c2bf tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:07.275519 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b7e8d221-b456-477c-b27b-bf234785c2bf tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:07.276944 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b7e8d221-b456-477c-b27b-bf234785c2bf tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:07.276944 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b7e8d221-b456-477c-b27b-bf234785c2bf tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:07.333417 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-78da8931-c8ca-4670-8fdf-f6f71c184273 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28642 microversion: 2.1 time: 0.149656 Aug 27 04:34:07.334376 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 221/448] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:34:07 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28642 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:34:07.404729 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-b7e8d221-b456-477c-b27b-bf234785c2bf tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28584 microversion: 2.20 time: 0.145409 Aug 27 04:34:07.406113 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 228/449] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:34:07 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28584 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:34:07.466502 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-2e7cbbe2-37db-450b-9654-cf6e40ebeeb6 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:07.467201 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-2e7cbbe2-37db-450b-9654-cf6e40ebeeb6 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:07.475217 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2e7cbbe2-37db-450b-9654-cf6e40ebeeb6 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:07.475720 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2e7cbbe2-37db-450b-9654-cf6e40ebeeb6 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:07.476895 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2e7cbbe2-37db-450b-9654-cf6e40ebeeb6 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:07.477606 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2e7cbbe2-37db-450b-9654-cf6e40ebeeb6 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:07.651440 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-2e7cbbe2-37db-450b-9654-cf6e40ebeeb6 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:07.659942 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-2e7cbbe2-37db-450b-9654-cf6e40ebeeb6 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1521 microversion: 2.1 time: 0.197046 Aug 27 04:34:07.661495 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 222/450] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:34:07 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:08.351625 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-3462e9f2-4c83-4806-aefd-e62807f165df tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:08.352377 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-3462e9f2-4c83-4806-aefd-e62807f165df tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:08.359190 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3462e9f2-4c83-4806-aefd-e62807f165df tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:08.359718 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3462e9f2-4c83-4806-aefd-e62807f165df tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:08.360446 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3462e9f2-4c83-4806-aefd-e62807f165df tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:08.360881 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3462e9f2-4c83-4806-aefd-e62807f165df tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:08.417601 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-930e9cc9-aceb-4cef-86a2-ba3faec249fc tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:08.418515 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-930e9cc9-aceb-4cef-86a2-ba3faec249fc tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:08.431124 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-930e9cc9-aceb-4cef-86a2-ba3faec249fc tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:08.431627 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-930e9cc9-aceb-4cef-86a2-ba3faec249fc tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:08.432495 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-930e9cc9-aceb-4cef-86a2-ba3faec249fc tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:08.433541 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-930e9cc9-aceb-4cef-86a2-ba3faec249fc tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:08.475576 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-3462e9f2-4c83-4806-aefd-e62807f165df tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28642 microversion: 2.1 time: 0.132216 Aug 27 04:34:08.476260 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 229/451] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:34:08 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28642 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:34:08.560430 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-930e9cc9-aceb-4cef-86a2-ba3faec249fc tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28584 microversion: 2.20 time: 0.146538 Aug 27 04:34:08.561280 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 223/452] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:34:08 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28584 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:34:08.680552 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-43af71f3-dacf-4fbd-8ac4-677a1472a817 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:08.681543 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-43af71f3-dacf-4fbd-8ac4-677a1472a817 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:08.689260 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-43af71f3-dacf-4fbd-8ac4-677a1472a817 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:08.689753 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-43af71f3-dacf-4fbd-8ac4-677a1472a817 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:08.690830 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-43af71f3-dacf-4fbd-8ac4-677a1472a817 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:08.691504 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-43af71f3-dacf-4fbd-8ac4-677a1472a817 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:08.858070 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-43af71f3-dacf-4fbd-8ac4-677a1472a817 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:08.868866 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-43af71f3-dacf-4fbd-8ac4-677a1472a817 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1521 microversion: 2.1 time: 0.193108 Aug 27 04:34:08.870173 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 230/453] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:34:08 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:09.487414 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-902903ae-bd2d-44cb-a700-2cd5e92e40fd tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:09.488589 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-902903ae-bd2d-44cb-a700-2cd5e92e40fd tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:09.502858 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-902903ae-bd2d-44cb-a700-2cd5e92e40fd tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:09.503650 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-902903ae-bd2d-44cb-a700-2cd5e92e40fd tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:09.504712 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-902903ae-bd2d-44cb-a700-2cd5e92e40fd tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:09.505146 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-902903ae-bd2d-44cb-a700-2cd5e92e40fd tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:09.572462 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-7e1a2ee8-f51c-4a45-8466-a72677c60a45 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:09.574321 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-7e1a2ee8-f51c-4a45-8466-a72677c60a45 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:09.581107 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7e1a2ee8-f51c-4a45-8466-a72677c60a45 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:09.582134 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7e1a2ee8-f51c-4a45-8466-a72677c60a45 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:09.586145 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7e1a2ee8-f51c-4a45-8466-a72677c60a45 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:09.586915 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7e1a2ee8-f51c-4a45-8466-a72677c60a45 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:09.630340 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-902903ae-bd2d-44cb-a700-2cd5e92e40fd tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28642 microversion: 2.1 time: 0.146016 Aug 27 04:34:09.632958 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 224/454] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:34:09 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28642 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:34:09.717918 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-7e1a2ee8-f51c-4a45-8466-a72677c60a45 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28584 microversion: 2.20 time: 0.149242 Aug 27 04:34:09.718756 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 231/455] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:34:09 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28584 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:34:09.889218 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-09e4dedf-b545-4847-a9ea-70894658b632 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:09.890029 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-09e4dedf-b545-4847-a9ea-70894658b632 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:09.904149 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-09e4dedf-b545-4847-a9ea-70894658b632 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:09.904740 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-09e4dedf-b545-4847-a9ea-70894658b632 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:09.905631 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-09e4dedf-b545-4847-a9ea-70894658b632 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:09.906183 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-09e4dedf-b545-4847-a9ea-70894658b632 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:10.095940 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-09e4dedf-b545-4847-a9ea-70894658b632 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:10.104936 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-09e4dedf-b545-4847-a9ea-70894658b632 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1521 microversion: 2.1 time: 0.219658 Aug 27 04:34:10.106330 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 225/456] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:34:09 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:10.652880 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-714903aa-af41-45cd-bbad-35f70a87f0fc tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:10.660992 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-714903aa-af41-45cd-bbad-35f70a87f0fc tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:10.677477 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-714903aa-af41-45cd-bbad-35f70a87f0fc tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:10.678277 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-714903aa-af41-45cd-bbad-35f70a87f0fc tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:10.679074 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-714903aa-af41-45cd-bbad-35f70a87f0fc tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:10.681834 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-714903aa-af41-45cd-bbad-35f70a87f0fc tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:10.735061 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-384c028d-5333-43ae-a39b-76d7519450be tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:10.738270 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-384c028d-5333-43ae-a39b-76d7519450be tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:10.748042 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-384c028d-5333-43ae-a39b-76d7519450be tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:10.748866 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-384c028d-5333-43ae-a39b-76d7519450be tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:10.749955 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-384c028d-5333-43ae-a39b-76d7519450be tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:10.750752 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-384c028d-5333-43ae-a39b-76d7519450be tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:10.812938 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-714903aa-af41-45cd-bbad-35f70a87f0fc tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28642 microversion: 2.1 time: 0.170896 Aug 27 04:34:10.835465 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 232/457] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:34:10 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28642 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:34:10.947163 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-384c028d-5333-43ae-a39b-76d7519450be tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28584 microversion: 2.20 time: 0.218092 Aug 27 04:34:10.947736 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 226/458] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:34:10 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28584 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:34:11.124259 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-f95e5a9c-0e4b-468f-b436-a8069a08846b tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:11.125393 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-f95e5a9c-0e4b-468f-b436-a8069a08846b tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:11.132918 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f95e5a9c-0e4b-468f-b436-a8069a08846b tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:11.133453 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f95e5a9c-0e4b-468f-b436-a8069a08846b tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:11.134305 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f95e5a9c-0e4b-468f-b436-a8069a08846b tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:11.134814 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f95e5a9c-0e4b-468f-b436-a8069a08846b tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:11.283912 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-f95e5a9c-0e4b-468f-b436-a8069a08846b tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:11.291866 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-f95e5a9c-0e4b-468f-b436-a8069a08846b tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1521 microversion: 2.1 time: 0.171646 Aug 27 04:34:11.301570 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 233/459] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:34:11 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:11.525170 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-5311c23a-f971-4b12-9f15-2d9f178ed3ce tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Action: 'create', calling method: .version_select at 0x7f20792e25e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1307425937"}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:11.547793 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.quota [None req-5311c23a-f971-4b12-9f15-2d9f178ed3ce tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Getting quotas for project c4d957eb500948908f38f0f427a9017b. Resources: {'key_pairs'} {{(pid=108970) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:34:11.553294 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.quota [None req-5311c23a-f971-4b12-9f15-2d9f178ed3ce tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Getting quotas for user 09b01f24964a490da63d33097d0f9a89 and project c4d957eb500948908f38f0f427a9017b. Resources: {'key_pairs'} {{(pid=108970) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:34:11.570895 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5311c23a-f971-4b12-9f15-2d9f178ed3ce tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [c70d6d1b-1aef-44a7-bb61-e17ecf68f1ff] AMQP server on 10.222.0.53:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 04:34:11.825659 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-43f532d7-8011-4454-a80e-dc9cbaea5bc0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:11.826551 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-43f532d7-8011-4454-a80e-dc9cbaea5bc0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:11.832878 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-43f532d7-8011-4454-a80e-dc9cbaea5bc0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:11.833325 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-43f532d7-8011-4454-a80e-dc9cbaea5bc0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:11.834110 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-43f532d7-8011-4454-a80e-dc9cbaea5bc0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:11.834546 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-43f532d7-8011-4454-a80e-dc9cbaea5bc0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:12.091779 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-43f532d7-8011-4454-a80e-dc9cbaea5bc0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28642 microversion: 2.1 time: 0.269643 Aug 27 04:34:12.092398 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 234/460] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:34:11 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28642 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:34:12.097416 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-e3417b70-b06f-4be9-b413-20c0888712be tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:12.098899 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-e3417b70-b06f-4be9-b413-20c0888712be tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:12.106470 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e3417b70-b06f-4be9-b413-20c0888712be tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:12.107003 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e3417b70-b06f-4be9-b413-20c0888712be tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:12.107950 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e3417b70-b06f-4be9-b413-20c0888712be tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:12.108424 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e3417b70-b06f-4be9-b413-20c0888712be tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:12.218749 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-e3417b70-b06f-4be9-b413-20c0888712be tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28584 microversion: 2.20 time: 0.124910 Aug 27 04:34:12.219669 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 235/461] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:34:12 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28584 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:34:12.310426 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-b77e43a2-cd66-42cb-bddc-d6ca987a5f61 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:12.311412 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-b77e43a2-cd66-42cb-bddc-d6ca987a5f61 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:12.319428 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b77e43a2-cd66-42cb-bddc-d6ca987a5f61 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:12.319907 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b77e43a2-cd66-42cb-bddc-d6ca987a5f61 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:12.320716 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b77e43a2-cd66-42cb-bddc-d6ca987a5f61 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:12.321154 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b77e43a2-cd66-42cb-bddc-d6ca987a5f61 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:12.444332 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-b77e43a2-cd66-42cb-bddc-d6ca987a5f61 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:12.451572 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-b77e43a2-cd66-42cb-bddc-d6ca987a5f61 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1521 microversion: 2.1 time: 0.145878 Aug 27 04:34:12.452176 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 236/462] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:34:12 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:34:12.587526 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO oslo.messaging._drivers.impl_rabbit [None req-5311c23a-f971-4b12-9f15-2d9f178ed3ce tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [c70d6d1b-1aef-44a7-bb61-e17ecf68f1ff] Reconnected to AMQP server on 10.222.0.53:5672 via [amqp] client with port 40548. Aug 27 04:34:12.773090 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.quota [None req-5311c23a-f971-4b12-9f15-2d9f178ed3ce tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Getting quotas for project c4d957eb500948908f38f0f427a9017b. Resources: {'key_pairs'} {{(pid=108970) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:34:12.776780 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.quota [None req-5311c23a-f971-4b12-9f15-2d9f178ed3ce tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Getting quotas for user 09b01f24964a490da63d33097d0f9a89 and project c4d957eb500948908f38f0f427a9017b. Resources: {'key_pairs'} {{(pid=108970) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:34:12.789441 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-5311c23a-f971-4b12-9f15-2d9f178ed3ce tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 1.268397 Aug 27 04:34:12.790042 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 227/463] 10.222.0.53 () {60 vars in 1158 bytes} [Fri Aug 27 04:34:11 2021] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:34:12.839476 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-8ac5e1bd-e697-4ff0-bf13-211ac094bbaf tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-221318581", "imageRef": "1937d7b1-8803-4a70-b19c-a8053bf32d4a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1307425937", "networks": [{"uuid": "6393701f-2879-4fc5-bc44-476f65707d09"}]}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:12.890821 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.network.neutron [None req-8ac5e1bd-e697-4ff0-bf13-211ac094bbaf tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] validate_networks() for [('6393701f-2879-4fc5-bc44-476f65707d09', None, None, None, None, None)] {{(pid=108971) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 04:34:13.103822 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-b594b5e2-2d22-446c-8ee0-b1072c85bd3d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:13.105026 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-b594b5e2-2d22-446c-8ee0-b1072c85bd3d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:13.112455 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b594b5e2-2d22-446c-8ee0-b1072c85bd3d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:13.113073 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b594b5e2-2d22-446c-8ee0-b1072c85bd3d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:13.114213 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b594b5e2-2d22-446c-8ee0-b1072c85bd3d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:13.114717 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b594b5e2-2d22-446c-8ee0-b1072c85bd3d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:13.263104 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.virt.hardware [None req-8ac5e1bd-e697-4ff0-bf13-211ac094bbaf tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Flavor limits 0:0:0 {{(pid=108971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:34:13.263516 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.virt.hardware [None req-8ac5e1bd-e697-4ff0-bf13-211ac094bbaf tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Image limits 0:0:0 {{(pid=108971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:34:13.263976 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.virt.hardware [None req-8ac5e1bd-e697-4ff0-bf13-211ac094bbaf tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Flavor pref 0:0:0 {{(pid=108971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:34:13.264402 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.virt.hardware [None req-8ac5e1bd-e697-4ff0-bf13-211ac094bbaf tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Image pref 0:0:0 {{(pid=108971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:34:13.264800 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.virt.hardware [None req-8ac5e1bd-e697-4ff0-bf13-211ac094bbaf tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:34:13.274026 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8ac5e1bd-e697-4ff0-bf13-211ac094bbaf tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:13.274461 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8ac5e1bd-e697-4ff0-bf13-211ac094bbaf tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:13.275243 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8ac5e1bd-e697-4ff0-bf13-211ac094bbaf tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:13.275692 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8ac5e1bd-e697-4ff0-bf13-211ac094bbaf tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:13.292873 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.quota [None req-8ac5e1bd-e697-4ff0-bf13-211ac094bbaf tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Getting quotas for project c4d957eb500948908f38f0f427a9017b. Resources: {'ram', 'cores', 'instances'} {{(pid=108971) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:34:13.296731 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.quota [None req-8ac5e1bd-e697-4ff0-bf13-211ac094bbaf tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Getting quotas for user 09b01f24964a490da63d33097d0f9a89 and project c4d957eb500948908f38f0f427a9017b. Resources: {'ram', 'cores', 'instances'} {{(pid=108971) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:34:13.307379 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-b594b5e2-2d22-446c-8ee0-b1072c85bd3d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28642 microversion: 2.1 time: 0.207118 Aug 27 04:34:13.307592 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-8ac5e1bd-e697-4ff0-bf13-211ac094bbaf tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Going to run 1 instances... {{(pid=108971) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 04:34:13.308043 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 228/464] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:34:13 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28642 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:34:13.309686 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-8ac5e1bd-e697-4ff0-bf13-211ac094bbaf tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [instance: 89e425c1-0168-4f5d-8635-dd6b9f88c580] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1937d7b1-8803-4a70-b19c-a8053bf32d4a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 04:34:13.312994 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-9d0679b5-797b-43cc-b18e-2d42514c3708 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:13.313983 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-9d0679b5-797b-43cc-b18e-2d42514c3708 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:13.321944 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9d0679b5-797b-43cc-b18e-2d42514c3708 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:13.322470 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9d0679b5-797b-43cc-b18e-2d42514c3708 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:13.323451 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9d0679b5-797b-43cc-b18e-2d42514c3708 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:13.323896 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9d0679b5-797b-43cc-b18e-2d42514c3708 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:13.361399 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-8ac5e1bd-e697-4ff0-bf13-211ac094bbaf tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.525563 Aug 27 04:34:13.367502 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 237/465] 10.222.0.53 () {60 vars in 1147 bytes} [Fri Aug 27 04:34:12 2021] POST /compute/v2.1/servers => generated 380 bytes in 527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:34:13.372903 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-fb249a5f-d426-4319-ba86-2a93422456d8 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:13.373513 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-fb249a5f-d426-4319-ba86-2a93422456d8 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [instance: 89e425c1-0168-4f5d-8635-dd6b9f88c580] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:13.429160 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-fb249a5f-d426-4319-ba86-2a93422456d8 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b01f24964a490da63d33097d0f9a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d957eb500948908f38f0f427a9017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:13.437873 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-9d0679b5-797b-43cc-b18e-2d42514c3708 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28584 microversion: 2.20 time: 0.128000 Aug 27 04:34:13.438241 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-fb249a5f-d426-4319-ba86-2a93422456d8 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580" status: 200 len: 1258 microversion: 2.1 time: 0.068393 Aug 27 04:34:13.438241 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 238/466] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:34:13 2021] GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580 => generated 1258 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:13.445350 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 229/467] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:34:13 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28584 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:34:13.467959 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-ff045ff8-2600-4737-ad33-39da0fc01a52 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:13.468596 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-ff045ff8-2600-4737-ad33-39da0fc01a52 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:13.475341 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ff045ff8-2600-4737-ad33-39da0fc01a52 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:13.475789 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ff045ff8-2600-4737-ad33-39da0fc01a52 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:13.476596 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ff045ff8-2600-4737-ad33-39da0fc01a52 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:13.477032 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ff045ff8-2600-4737-ad33-39da0fc01a52 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:13.605651 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-ff045ff8-2600-4737-ad33-39da0fc01a52 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:13.613625 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-ff045ff8-2600-4737-ad33-39da0fc01a52 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1521 microversion: 2.1 time: 0.149153 Aug 27 04:34:13.614199 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 239/468] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:34:13 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:14.320893 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-2d775c0a-4a7f-4bf5-aab6-2217c659a2c0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:14.321881 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-2d775c0a-4a7f-4bf5-aab6-2217c659a2c0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:14.331405 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2d775c0a-4a7f-4bf5-aab6-2217c659a2c0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:14.331875 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2d775c0a-4a7f-4bf5-aab6-2217c659a2c0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:14.333269 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2d775c0a-4a7f-4bf5-aab6-2217c659a2c0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:14.336218 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2d775c0a-4a7f-4bf5-aab6-2217c659a2c0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:14.449819 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-5e852a68-2707-4904-bb71-9a07757b2e34 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:14.450840 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-5e852a68-2707-4904-bb71-9a07757b2e34 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:14.457002 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5e852a68-2707-4904-bb71-9a07757b2e34 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:14.457465 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5e852a68-2707-4904-bb71-9a07757b2e34 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:14.458237 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5e852a68-2707-4904-bb71-9a07757b2e34 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:14.458662 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5e852a68-2707-4904-bb71-9a07757b2e34 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:14.546910 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-2d775c0a-4a7f-4bf5-aab6-2217c659a2c0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 28667 microversion: 2.1 time: 0.231055 Aug 27 04:34:14.548740 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 230/469] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:34:14 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 28667 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:34:14.553588 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-166e3969-9d2e-4ab2-a2fa-6adf2f800f0c tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:14.554288 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-166e3969-9d2e-4ab2-a2fa-6adf2f800f0c tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [instance: 89e425c1-0168-4f5d-8635-dd6b9f88c580] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:14.560663 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-166e3969-9d2e-4ab2-a2fa-6adf2f800f0c tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:14.561118 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-166e3969-9d2e-4ab2-a2fa-6adf2f800f0c tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:14.561914 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-166e3969-9d2e-4ab2-a2fa-6adf2f800f0c tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:14.562351 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-166e3969-9d2e-4ab2-a2fa-6adf2f800f0c tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:14.625059 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-166e3969-9d2e-4ab2-a2fa-6adf2f800f0c tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b01f24964a490da63d33097d0f9a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d957eb500948908f38f0f427a9017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:14.632405 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-166e3969-9d2e-4ab2-a2fa-6adf2f800f0c tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580" status: 200 len: 1310 microversion: 2.1 time: 0.082508 Aug 27 04:34:14.632970 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 231/470] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:34:14 2021] GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580 => generated 1310 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:14.637145 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-f24be015-6d20-4f6f-ac51-191808b9e101 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:14.637748 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-f24be015-6d20-4f6f-ac51-191808b9e101 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:14.643280 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f24be015-6d20-4f6f-ac51-191808b9e101 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:14.643732 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f24be015-6d20-4f6f-ac51-191808b9e101 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:14.645056 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f24be015-6d20-4f6f-ac51-191808b9e101 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:14.645505 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f24be015-6d20-4f6f-ac51-191808b9e101 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:14.767695 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-f24be015-6d20-4f6f-ac51-191808b9e101 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:14.773161 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-5e852a68-2707-4904-bb71-9a07757b2e34 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28584 microversion: 2.20 time: 0.327013 Aug 27 04:34:14.773801 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 240/471] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:34:14 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28584 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:34:14.775874 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-f24be015-6d20-4f6f-ac51-191808b9e101 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1521 microversion: 2.1 time: 0.141914 Aug 27 04:34:14.776472 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 232/472] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:34:14 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1521 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:15.559020 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-fc21c98e-8b43-483f-915f-42103257d245 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:15.560166 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-fc21c98e-8b43-483f-915f-42103257d245 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:15.573067 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-fc21c98e-8b43-483f-915f-42103257d245 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:15.573939 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-fc21c98e-8b43-483f-915f-42103257d245 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:15.574733 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-fc21c98e-8b43-483f-915f-42103257d245 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:15.575168 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-fc21c98e-8b43-483f-915f-42103257d245 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:15.650240 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-2309b1e4-e9c6-47f0-acc7-27da8572ca02 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:15.651125 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-2309b1e4-e9c6-47f0-acc7-27da8572ca02 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [instance: 89e425c1-0168-4f5d-8635-dd6b9f88c580] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:15.657473 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2309b1e4-e9c6-47f0-acc7-27da8572ca02 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:15.658046 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2309b1e4-e9c6-47f0-acc7-27da8572ca02 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:15.658912 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2309b1e4-e9c6-47f0-acc7-27da8572ca02 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:15.659268 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2309b1e4-e9c6-47f0-acc7-27da8572ca02 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:15.705348 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-fc21c98e-8b43-483f-915f-42103257d245 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 29603 microversion: 2.1 time: 0.150379 Aug 27 04:34:15.706007 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 241/473] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:34:15 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 29603 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:34:15.724888 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-2309b1e4-e9c6-47f0-acc7-27da8572ca02 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b01f24964a490da63d33097d0f9a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d957eb500948908f38f0f427a9017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:15.732351 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-2309b1e4-e9c6-47f0-acc7-27da8572ca02 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580" status: 200 len: 1316 microversion: 2.1 time: 0.086315 Aug 27 04:34:15.733079 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 233/474] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:34:15 2021] GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580 => generated 1316 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:34:15.786434 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-33ad845c-34b5-448e-8408-f7266f9cdeaa tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:15.788681 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-33ad845c-34b5-448e-8408-f7266f9cdeaa tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:15.799783 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-33ad845c-34b5-448e-8408-f7266f9cdeaa tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:15.800561 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-33ad845c-34b5-448e-8408-f7266f9cdeaa tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:15.801996 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-33ad845c-34b5-448e-8408-f7266f9cdeaa tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:15.802443 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-33ad845c-34b5-448e-8408-f7266f9cdeaa tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:15.808496 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-9d0ea814-000c-47bc-a248-63a9d2142e53 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:15.809339 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-9d0ea814-000c-47bc-a248-63a9d2142e53 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:15.815413 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9d0ea814-000c-47bc-a248-63a9d2142e53 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:15.815863 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9d0ea814-000c-47bc-a248-63a9d2142e53 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:15.817087 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9d0ea814-000c-47bc-a248-63a9d2142e53 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:15.817692 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9d0ea814-000c-47bc-a248-63a9d2142e53 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:15.939740 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-33ad845c-34b5-448e-8408-f7266f9cdeaa tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 28584 microversion: 2.20 time: 0.158249 Aug 27 04:34:15.941068 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 242/475] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:34:15 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 28584 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:34:15.966160 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-9d0ea814-000c-47bc-a248-63a9d2142e53 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:15.974922 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-9d0ea814-000c-47bc-a248-63a9d2142e53 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1501 microversion: 2.1 time: 0.181707 Aug 27 04:34:15.976180 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 234/476] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:34:15 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1501 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:15.993249 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-3ee9a6ec-cee0-4024-84a1-74c3d85663ed tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b59a4b03-4072-4ff2-9d45-7a0098d461dc"}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:15.994596 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-3ee9a6ec-cee0-4024-84a1-74c3d85663ed tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:16.010002 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3ee9a6ec-cee0-4024-84a1-74c3d85663ed tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:16.010557 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3ee9a6ec-cee0-4024-84a1-74c3d85663ed tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:16.011715 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3ee9a6ec-cee0-4024-84a1-74c3d85663ed tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:16.012334 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3ee9a6ec-cee0-4024-84a1-74c3d85663ed tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:16.059301 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.wsgi [None req-3ee9a6ec-cee0-4024-84a1-74c3d85663ed tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] HTTP exception thrown: Cannot 'attach_volume' instance 0e594817-f3cc-40e6-babe-c736641fb9a9 while it is in vm_state rescued Aug 27 04:34:16.059900 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-3ee9a6ec-cee0-4024-84a1-74c3d85663ed tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Returning 409 to user: Cannot 'attach_volume' instance 0e594817-f3cc-40e6-babe-c736641fb9a9 while it is in vm_state rescued {{(pid=108971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:34:16.061191 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-3ee9a6ec-cee0-4024-84a1-74c3d85663ed tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "POST /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.072702 Aug 27 04:34:16.061739 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 243/477] 10.222.0.53 () {60 vars in 1323 bytes} [Fri Aug 27 04:34:15 2021] POST /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9/os-volume_attachments => generated 152 bytes in 74 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:34:16.070638 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-48fd917c-2ab3-47e3-bee6-42cca838edd1 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:16.071170 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-48fd917c-2ab3-47e3-bee6-42cca838edd1 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:16.086079 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-48fd917c-2ab3-47e3-bee6-42cca838edd1 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:16.086537 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-48fd917c-2ab3-47e3-bee6-42cca838edd1 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:16.087338 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-48fd917c-2ab3-47e3-bee6-42cca838edd1 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:16.087778 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-48fd917c-2ab3-47e3-bee6-42cca838edd1 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:16.237394 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-48fd917c-2ab3-47e3-bee6-42cca838edd1 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "POST /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9/action" status: 202 len: 0 microversion: 2.1 time: 0.170670 Aug 27 04:34:16.238378 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 235/478] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:34:16 2021] POST /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:34:16.246150 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-73c4c62e-13e5-4bf0-87f8-749a9a92e96a tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:16.247212 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-73c4c62e-13e5-4bf0-87f8-749a9a92e96a tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:16.259736 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-73c4c62e-13e5-4bf0-87f8-749a9a92e96a tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:16.260284 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-73c4c62e-13e5-4bf0-87f8-749a9a92e96a tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:16.261015 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-73c4c62e-13e5-4bf0-87f8-749a9a92e96a tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:16.261724 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-73c4c62e-13e5-4bf0-87f8-749a9a92e96a tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:16.422524 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-73c4c62e-13e5-4bf0-87f8-749a9a92e96a tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:16.431710 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-73c4c62e-13e5-4bf0-87f8-749a9a92e96a tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1509 microversion: 2.1 time: 0.189102 Aug 27 04:34:16.439699 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 244/479] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:34:16 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1509 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:16.717417 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-3e4cfb0f-e5d6-411f-bcf5-f50a1e88a712 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:16.718384 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-3e4cfb0f-e5d6-411f-bcf5-f50a1e88a712 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:16.725194 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3e4cfb0f-e5d6-411f-bcf5-f50a1e88a712 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:16.725646 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3e4cfb0f-e5d6-411f-bcf5-f50a1e88a712 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:16.726415 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3e4cfb0f-e5d6-411f-bcf5-f50a1e88a712 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:16.726862 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3e4cfb0f-e5d6-411f-bcf5-f50a1e88a712 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:16.752039 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-a3fe7d64-3f33-4099-b174-a97e0d986cb8 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:16.753296 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-a3fe7d64-3f33-4099-b174-a97e0d986cb8 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [instance: 89e425c1-0168-4f5d-8635-dd6b9f88c580] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:16.758819 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a3fe7d64-3f33-4099-b174-a97e0d986cb8 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:16.759331 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a3fe7d64-3f33-4099-b174-a97e0d986cb8 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:16.760193 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a3fe7d64-3f33-4099-b174-a97e0d986cb8 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:16.760692 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a3fe7d64-3f33-4099-b174-a97e0d986cb8 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:16.885572 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-a3fe7d64-3f33-4099-b174-a97e0d986cb8 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b01f24964a490da63d33097d0f9a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d957eb500948908f38f0f427a9017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:16.893717 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-a3fe7d64-3f33-4099-b174-a97e0d986cb8 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580" status: 200 len: 1358 microversion: 2.1 time: 0.145181 Aug 27 04:34:16.894297 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 245/480] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:34:16 2021] GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580 => generated 1358 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:16.952674 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-3895d76e-a74f-41ea-a1ec-b7cc028c491c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:16.953594 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-3895d76e-a74f-41ea-a1ec-b7cc028c491c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:16.960270 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3895d76e-a74f-41ea-a1ec-b7cc028c491c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:16.960717 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3895d76e-a74f-41ea-a1ec-b7cc028c491c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:16.961487 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3895d76e-a74f-41ea-a1ec-b7cc028c491c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:16.961922 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3895d76e-a74f-41ea-a1ec-b7cc028c491c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:39.752662 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-3895d76e-a74f-41ea-a1ec-b7cc028c491c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 200 len: 38267 microversion: 2.20 time: 22.803517 Aug 27 04:34:39.758839 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 246/481] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:34:16 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 38267 bytes in 22805 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:34:39.759167 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-70a128e1-0a3c-4f81-846b-1e58e3446ad1 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:39.759876 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-70a128e1-0a3c-4f81-846b-1e58e3446ad1 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:39.766337 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-70a128e1-0a3c-4f81-846b-1e58e3446ad1 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:39.766786 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-70a128e1-0a3c-4f81-846b-1e58e3446ad1 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:39.767560 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-70a128e1-0a3c-4f81-846b-1e58e3446ad1 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:39.768012 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-70a128e1-0a3c-4f81-846b-1e58e3446ad1 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:39.809265 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-3e4cfb0f-e5d6-411f-bcf5-f50a1e88a712 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 200 len: 38297 microversion: 2.1 time: 23.095750 Aug 27 04:34:39.814912 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 236/482] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:34:16 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 38297 bytes in 23098 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:34:39.815399 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-93b1522e-6afb-429e-b91f-40c96a44ed3c tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:39.816155 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-93b1522e-6afb-429e-b91f-40c96a44ed3c tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [instance: 89e425c1-0168-4f5d-8635-dd6b9f88c580] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:39.823398 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-93b1522e-6afb-429e-b91f-40c96a44ed3c tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:39.823849 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-93b1522e-6afb-429e-b91f-40c96a44ed3c tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:39.824670 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-93b1522e-6afb-429e-b91f-40c96a44ed3c tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:39.825111 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-93b1522e-6afb-429e-b91f-40c96a44ed3c tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:40.023447 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-93b1522e-6afb-429e-b91f-40c96a44ed3c tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b01f24964a490da63d33097d0f9a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d957eb500948908f38f0f427a9017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:40.030941 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-93b1522e-6afb-429e-b91f-40c96a44ed3c tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580" status: 200 len: 1358 microversion: 2.1 time: 0.219368 Aug 27 04:34:40.041233 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 237/483] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:34:39 2021] GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580 => generated 1358 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:40.041233 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-a43d4d3f-455f-4f8e-8bc3-6ba59e8bdef7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:40.041233 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-a43d4d3f-455f-4f8e-8bc3-6ba59e8bdef7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:40.044047 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a43d4d3f-455f-4f8e-8bc3-6ba59e8bdef7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:40.044562 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a43d4d3f-455f-4f8e-8bc3-6ba59e8bdef7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:40.045337 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a43d4d3f-455f-4f8e-8bc3-6ba59e8bdef7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:40.045893 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a43d4d3f-455f-4f8e-8bc3-6ba59e8bdef7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:40.070219 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-a43d4d3f-455f-4f8e-8bc3-6ba59e8bdef7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/ips" status: 200 len: 153 microversion: 2.20 time: 0.037507 Aug 27 04:34:40.076637 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 238/484] 10.222.0.53 () {60 vars in 1289 bytes} [Fri Aug 27 04:34:40 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/ips => generated 153 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:34:40.076637 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-cc631f8c-15b6-4c50-85b6-059986cdea5d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:40.076637 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-cc631f8c-15b6-4c50-85b6-059986cdea5d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:40.083173 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-cc631f8c-15b6-4c50-85b6-059986cdea5d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:40.084757 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-cc631f8c-15b6-4c50-85b6-059986cdea5d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:40.085565 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-cc631f8c-15b6-4c50-85b6-059986cdea5d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:40.086016 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-cc631f8c-15b6-4c50-85b6-059986cdea5d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:40.111924 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-cc631f8c-15b6-4c50-85b6-059986cdea5d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/ips" status: 200 len: 146 microversion: 2.1 time: 0.039925 Aug 27 04:34:40.117769 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 239/485] 10.222.0.53 () {58 vars in 1248 bytes} [Fri Aug 27 04:34:40 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/ips => generated 146 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:34:40.281989 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-70a128e1-0a3c-4f81-846b-1e58e3446ad1 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:40.293901 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-70a128e1-0a3c-4f81-846b-1e58e3446ad1 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1509 microversion: 2.1 time: 0.537943 Aug 27 04:34:40.296009 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 247/486] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:34:39 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1509 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:40.559266 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [req-f0714227-f2d4-4da3-b8e5-20c68368ee7d req-e88b100f-fc8f-414e-a131-fbd7ad57395d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89e425c1-0168-4f5d-8635-dd6b9f88c580", "tag": "6348fecd-7464-4987-a099-9e9f7e860b0c"}]} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:40.560798 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:34:40.560798 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: warnings.warn(msg) Aug 27 04:34:40.568122 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-f0714227-f2d4-4da3-b8e5-20c68368ee7d req-e88b100f-fc8f-414e-a131-fbd7ad57395d service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:40.568580 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-f0714227-f2d4-4da3-b8e5-20c68368ee7d req-e88b100f-fc8f-414e-a131-fbd7ad57395d service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:40.596600 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.compute.server_external_events [req-f0714227-f2d4-4da3-b8e5-20c68368ee7d req-e88b100f-fc8f-414e-a131-fbd7ad57395d service nova] Creating event network-changed:6348fecd-7464-4987-a099-9e9f7e860b0c for instance 89e425c1-0168-4f5d-8635-dd6b9f88c580 on hv-cinder-80403 Aug 27 04:34:40.604570 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [req-f0714227-f2d4-4da3-b8e5-20c68368ee7d req-e88b100f-fc8f-414e-a131-fbd7ad57395d service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048905 Aug 27 04:34:40.605496 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 240/487] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:34:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:34:41.047839 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-95b7ac8f-07d2-493f-bf31-daef0dc4ecb1 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:41.048484 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-95b7ac8f-07d2-493f-bf31-daef0dc4ecb1 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [instance: 89e425c1-0168-4f5d-8635-dd6b9f88c580] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:41.055428 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-95b7ac8f-07d2-493f-bf31-daef0dc4ecb1 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:41.055879 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-95b7ac8f-07d2-493f-bf31-daef0dc4ecb1 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:41.056699 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-95b7ac8f-07d2-493f-bf31-daef0dc4ecb1 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:41.057131 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-95b7ac8f-07d2-493f-bf31-daef0dc4ecb1 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:41.201059 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-95b7ac8f-07d2-493f-bf31-daef0dc4ecb1 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b01f24964a490da63d33097d0f9a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d957eb500948908f38f0f427a9017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:41.208922 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-95b7ac8f-07d2-493f-bf31-daef0dc4ecb1 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580" status: 200 len: 1358 microversion: 2.1 time: 0.164679 Aug 27 04:34:41.209608 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 248/488] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:34:41 2021] GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:41.314105 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-67da58d4-1e6b-4f36-b70b-7c98087cecc0 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:41.314807 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-67da58d4-1e6b-4f36-b70b-7c98087cecc0 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:41.321503 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-67da58d4-1e6b-4f36-b70b-7c98087cecc0 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:41.321949 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-67da58d4-1e6b-4f36-b70b-7c98087cecc0 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:41.322719 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-67da58d4-1e6b-4f36-b70b-7c98087cecc0 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:41.323157 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-67da58d4-1e6b-4f36-b70b-7c98087cecc0 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:41.447092 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-67da58d4-1e6b-4f36-b70b-7c98087cecc0 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:41.454554 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-67da58d4-1e6b-4f36-b70b-7c98087cecc0 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1509 microversion: 2.1 time: 0.144923 Aug 27 04:34:41.455498 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 241/489] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:34:41 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1509 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:42.228348 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-192d91b6-4e77-410e-93fe-c60432a11308 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:42.229127 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-192d91b6-4e77-410e-93fe-c60432a11308 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [instance: 89e425c1-0168-4f5d-8635-dd6b9f88c580] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:42.235110 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-192d91b6-4e77-410e-93fe-c60432a11308 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:42.235609 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-192d91b6-4e77-410e-93fe-c60432a11308 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:42.236561 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-192d91b6-4e77-410e-93fe-c60432a11308 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:42.237044 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-192d91b6-4e77-410e-93fe-c60432a11308 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:42.375572 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-192d91b6-4e77-410e-93fe-c60432a11308 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b01f24964a490da63d33097d0f9a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d957eb500948908f38f0f427a9017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:42.383949 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-192d91b6-4e77-410e-93fe-c60432a11308 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580" status: 200 len: 1358 microversion: 2.1 time: 0.159368 Aug 27 04:34:42.384726 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 249/490] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:34:42 2021] GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:42.473721 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-ba348377-5a32-4f73-b6b8-1dc9a8edddde tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:42.473721 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-ba348377-5a32-4f73-b6b8-1dc9a8edddde tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:42.479483 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ba348377-5a32-4f73-b6b8-1dc9a8edddde tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:42.479872 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ba348377-5a32-4f73-b6b8-1dc9a8edddde tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:42.480681 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ba348377-5a32-4f73-b6b8-1dc9a8edddde tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:42.481120 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ba348377-5a32-4f73-b6b8-1dc9a8edddde tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:42.626081 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-ba348377-5a32-4f73-b6b8-1dc9a8edddde tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:42.634069 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-ba348377-5a32-4f73-b6b8-1dc9a8edddde tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1509 microversion: 2.1 time: 0.165617 Aug 27 04:34:42.634879 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 242/491] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:34:42 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1509 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:43.400304 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-7c92765b-9244-40b4-b0bd-b203322fadde tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:43.400940 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-7c92765b-9244-40b4-b0bd-b203322fadde tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [instance: 89e425c1-0168-4f5d-8635-dd6b9f88c580] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:43.407155 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7c92765b-9244-40b4-b0bd-b203322fadde tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:43.407591 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7c92765b-9244-40b4-b0bd-b203322fadde tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:43.408372 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7c92765b-9244-40b4-b0bd-b203322fadde tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:43.408800 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7c92765b-9244-40b4-b0bd-b203322fadde tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:43.528287 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-7c92765b-9244-40b4-b0bd-b203322fadde tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b01f24964a490da63d33097d0f9a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d957eb500948908f38f0f427a9017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:43.535945 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-7c92765b-9244-40b4-b0bd-b203322fadde tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580" status: 200 len: 1358 microversion: 2.1 time: 0.139308 Aug 27 04:34:43.536527 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 250/492] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:34:43 2021] GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580 => generated 1358 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:43.653409 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-9c7a1ae3-b232-4514-846a-d6fdea2f1702 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:43.653935 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-9c7a1ae3-b232-4514-846a-d6fdea2f1702 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:43.660819 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9c7a1ae3-b232-4514-846a-d6fdea2f1702 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:43.661278 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9c7a1ae3-b232-4514-846a-d6fdea2f1702 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:43.662048 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9c7a1ae3-b232-4514-846a-d6fdea2f1702 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:43.662489 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9c7a1ae3-b232-4514-846a-d6fdea2f1702 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:43.783521 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-9c7a1ae3-b232-4514-846a-d6fdea2f1702 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:43.791466 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-9c7a1ae3-b232-4514-846a-d6fdea2f1702 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1509 microversion: 2.1 time: 0.141780 Aug 27 04:34:43.792040 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 243/493] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:34:43 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1509 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:43.958391 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-0d1e5f1b-7cdc-4755-a7b0-976417493742 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:43.958821 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-0d1e5f1b-7cdc-4755-a7b0-976417493742 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:43.964785 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0d1e5f1b-7cdc-4755-a7b0-976417493742 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:43.965233 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0d1e5f1b-7cdc-4755-a7b0-976417493742 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:43.965996 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0d1e5f1b-7cdc-4755-a7b0-976417493742 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:43.966431 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0d1e5f1b-7cdc-4755-a7b0-976417493742 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:43.989063 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.objects.instance [None req-0d1e5f1b-7cdc-4755-a7b0-976417493742 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lazy-loading 'flavor' on Instance uuid b3173859-725e-4d66-80af-4223a6643935 {{(pid=108971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:34:44.250037 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-0d1e5f1b-7cdc-4755-a7b0-976417493742 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 202 len: 0 microversion: 2.20 time: 0.295736 Aug 27 04:34:44.250732 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 251/494] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:34:43 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:34:44.259138 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-f8e0aad3-72d4-4a1d-b878-9d64f55846b7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:44.259965 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-f8e0aad3-72d4-4a1d-b878-9d64f55846b7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:44.266347 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f8e0aad3-72d4-4a1d-b878-9d64f55846b7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:44.267007 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f8e0aad3-72d4-4a1d-b878-9d64f55846b7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:44.267786 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f8e0aad3-72d4-4a1d-b878-9d64f55846b7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:44.268274 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f8e0aad3-72d4-4a1d-b878-9d64f55846b7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:44.391210 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-f8e0aad3-72d4-4a1d-b878-9d64f55846b7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:44.399314 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-f8e0aad3-72d4-4a1d-b878-9d64f55846b7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:44.400976 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-f8e0aad3-72d4-4a1d-b878-9d64f55846b7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:44.402121 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-f8e0aad3-72d4-4a1d-b878-9d64f55846b7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1724 microversion: 2.20 time: 0.146671 Aug 27 04:34:44.402687 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 244/495] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:34:44 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:34:44.553631 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-4cbfbfa0-adc4-43c8-8c02-9e92d985934c tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:44.554333 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-4cbfbfa0-adc4-43c8-8c02-9e92d985934c tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [instance: 89e425c1-0168-4f5d-8635-dd6b9f88c580] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:44.561474 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-4cbfbfa0-adc4-43c8-8c02-9e92d985934c tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:44.561913 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-4cbfbfa0-adc4-43c8-8c02-9e92d985934c tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:44.562678 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-4cbfbfa0-adc4-43c8-8c02-9e92d985934c tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:44.563109 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-4cbfbfa0-adc4-43c8-8c02-9e92d985934c tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:44.690530 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-4cbfbfa0-adc4-43c8-8c02-9e92d985934c tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b01f24964a490da63d33097d0f9a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d957eb500948908f38f0f427a9017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:44.698506 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-4cbfbfa0-adc4-43c8-8c02-9e92d985934c tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580" status: 200 len: 1358 microversion: 2.1 time: 0.149559 Aug 27 04:34:44.699067 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 252/496] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:34:44 2021] GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:44.808290 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-b447b39e-52c2-41ed-9dfb-a6d42987b0d8 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:44.808828 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-b447b39e-52c2-41ed-9dfb-a6d42987b0d8 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:44.815240 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-17d5d530-506e-44ab-9ffb-5f5133ef0702 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d6470fe4-57a6-4f9b-9798-61b3172d3f0f"}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:44.815423 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b447b39e-52c2-41ed-9dfb-a6d42987b0d8 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:44.815865 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b447b39e-52c2-41ed-9dfb-a6d42987b0d8 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:44.816453 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-17d5d530-506e-44ab-9ffb-5f5133ef0702 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:44.816730 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b447b39e-52c2-41ed-9dfb-a6d42987b0d8 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:44.817309 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b447b39e-52c2-41ed-9dfb-a6d42987b0d8 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:44.826291 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-17d5d530-506e-44ab-9ffb-5f5133ef0702 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:44.826990 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-17d5d530-506e-44ab-9ffb-5f5133ef0702 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:44.827881 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-17d5d530-506e-44ab-9ffb-5f5133ef0702 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:44.828441 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-17d5d530-506e-44ab-9ffb-5f5133ef0702 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:44.945041 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-b447b39e-52c2-41ed-9dfb-a6d42987b0d8 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:44.953941 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-b447b39e-52c2-41ed-9dfb-a6d42987b0d8 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1509 microversion: 2.1 time: 0.149420 Aug 27 04:34:44.954509 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 245/497] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:34:44 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1509 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:45.106739 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-17d5d530-506e-44ab-9ffb-5f5133ef0702 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299840 Aug 27 04:34:45.107376 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 253/498] 10.222.0.53 () {60 vars in 1323 bytes} [Fri Aug 27 04:34:44 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:34:45.423629 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-51e6904b-7117-4957-a6f8-d4b1e804fa65 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:45.424701 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-51e6904b-7117-4957-a6f8-d4b1e804fa65 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:45.433607 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-51e6904b-7117-4957-a6f8-d4b1e804fa65 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:45.434291 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-51e6904b-7117-4957-a6f8-d4b1e804fa65 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:45.435474 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-51e6904b-7117-4957-a6f8-d4b1e804fa65 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:45.436186 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-51e6904b-7117-4957-a6f8-d4b1e804fa65 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:45.567895 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-51e6904b-7117-4957-a6f8-d4b1e804fa65 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:45.575632 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-51e6904b-7117-4957-a6f8-d4b1e804fa65 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:45.577174 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-51e6904b-7117-4957-a6f8-d4b1e804fa65 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:45.578316 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-51e6904b-7117-4957-a6f8-d4b1e804fa65 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1724 microversion: 2.20 time: 0.160817 Aug 27 04:34:45.578881 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 246/499] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:34:45 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:34:45.716524 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-8c80d113-fb33-4812-ab2b-2a61adcfc261 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:45.717213 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-8c80d113-fb33-4812-ab2b-2a61adcfc261 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [instance: 89e425c1-0168-4f5d-8635-dd6b9f88c580] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:45.723695 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8c80d113-fb33-4812-ab2b-2a61adcfc261 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:45.724170 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8c80d113-fb33-4812-ab2b-2a61adcfc261 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:45.724928 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8c80d113-fb33-4812-ab2b-2a61adcfc261 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:45.725352 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8c80d113-fb33-4812-ab2b-2a61adcfc261 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:45.848472 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-8c80d113-fb33-4812-ab2b-2a61adcfc261 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b01f24964a490da63d33097d0f9a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d957eb500948908f38f0f427a9017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:45.856605 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-8c80d113-fb33-4812-ab2b-2a61adcfc261 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580" status: 200 len: 1358 microversion: 2.1 time: 0.144334 Aug 27 04:34:45.857208 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 254/500] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:34:45 2021] GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580 => generated 1358 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:45.970279 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-17c0cdd1-0ea2-4ea5-86af-fa0c53ebeba0 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:45.970834 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-17c0cdd1-0ea2-4ea5-86af-fa0c53ebeba0 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:45.976775 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-17c0cdd1-0ea2-4ea5-86af-fa0c53ebeba0 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:45.977235 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-17c0cdd1-0ea2-4ea5-86af-fa0c53ebeba0 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:45.978013 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-17c0cdd1-0ea2-4ea5-86af-fa0c53ebeba0 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:45.978460 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-17c0cdd1-0ea2-4ea5-86af-fa0c53ebeba0 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:46.110233 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-17c0cdd1-0ea2-4ea5-86af-fa0c53ebeba0 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:46.120428 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-17c0cdd1-0ea2-4ea5-86af-fa0c53ebeba0 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1509 microversion: 2.1 time: 0.153641 Aug 27 04:34:46.121042 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 247/501] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:34:45 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:46.630949 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-b8b408c4-b805-42b4-8904-9a026f84e8a2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:46.631553 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-b8b408c4-b805-42b4-8904-9a026f84e8a2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:46.639175 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b8b408c4-b805-42b4-8904-9a026f84e8a2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:46.639619 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b8b408c4-b805-42b4-8904-9a026f84e8a2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:46.640423 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b8b408c4-b805-42b4-8904-9a026f84e8a2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:46.640864 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b8b408c4-b805-42b4-8904-9a026f84e8a2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:46.764326 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-b8b408c4-b805-42b4-8904-9a026f84e8a2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:46.772584 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-b8b408c4-b805-42b4-8904-9a026f84e8a2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:46.774105 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-b8b408c4-b805-42b4-8904-9a026f84e8a2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:46.775251 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-b8b408c4-b805-42b4-8904-9a026f84e8a2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1724 microversion: 2.20 time: 0.148124 Aug 27 04:34:46.776095 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 255/502] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:34:46 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:34:46.874546 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-1e16b8a8-eafd-4947-878f-7fb3947b01c5 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:46.875319 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-1e16b8a8-eafd-4947-878f-7fb3947b01c5 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [instance: 89e425c1-0168-4f5d-8635-dd6b9f88c580] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:46.881752 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1e16b8a8-eafd-4947-878f-7fb3947b01c5 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:46.882025 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1e16b8a8-eafd-4947-878f-7fb3947b01c5 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:46.883108 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1e16b8a8-eafd-4947-878f-7fb3947b01c5 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:46.883734 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1e16b8a8-eafd-4947-878f-7fb3947b01c5 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:47.011938 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-1e16b8a8-eafd-4947-878f-7fb3947b01c5 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b01f24964a490da63d33097d0f9a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d957eb500948908f38f0f427a9017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:47.020387 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-1e16b8a8-eafd-4947-878f-7fb3947b01c5 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580" status: 200 len: 1358 microversion: 2.1 time: 0.149600 Aug 27 04:34:47.020953 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 248/503] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:34:46 2021] GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:47.138433 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-725bd952-89d9-4efe-903a-2074af7da27e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:47.138958 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-725bd952-89d9-4efe-903a-2074af7da27e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:47.145559 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-725bd952-89d9-4efe-903a-2074af7da27e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:47.146000 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-725bd952-89d9-4efe-903a-2074af7da27e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:47.146775 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-725bd952-89d9-4efe-903a-2074af7da27e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:47.147209 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-725bd952-89d9-4efe-903a-2074af7da27e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:47.282724 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-725bd952-89d9-4efe-903a-2074af7da27e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:47.290110 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-725bd952-89d9-4efe-903a-2074af7da27e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1515 microversion: 2.1 time: 0.155427 Aug 27 04:34:47.290657 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 256/504] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:34:47 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:47.801331 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-0e177ce2-13df-4307-9a35-990a11b036b1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:47.802071 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-0e177ce2-13df-4307-9a35-990a11b036b1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:47.809807 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0e177ce2-13df-4307-9a35-990a11b036b1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:47.810341 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0e177ce2-13df-4307-9a35-990a11b036b1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:47.811310 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0e177ce2-13df-4307-9a35-990a11b036b1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:47.811820 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0e177ce2-13df-4307-9a35-990a11b036b1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:47.938047 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-0e177ce2-13df-4307-9a35-990a11b036b1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:47.947446 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-0e177ce2-13df-4307-9a35-990a11b036b1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:47.949392 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-0e177ce2-13df-4307-9a35-990a11b036b1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:47.950832 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-0e177ce2-13df-4307-9a35-990a11b036b1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1724 microversion: 2.20 time: 0.154224 Aug 27 04:34:47.951526 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 249/505] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:34:47 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:34:48.037962 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-394e917d-3036-4054-bf3c-3ef8c69b144e tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:48.038565 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-394e917d-3036-4054-bf3c-3ef8c69b144e tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [instance: 89e425c1-0168-4f5d-8635-dd6b9f88c580] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:48.044491 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-394e917d-3036-4054-bf3c-3ef8c69b144e tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:48.044935 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-394e917d-3036-4054-bf3c-3ef8c69b144e tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:48.045689 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-394e917d-3036-4054-bf3c-3ef8c69b144e tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:48.046117 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-394e917d-3036-4054-bf3c-3ef8c69b144e tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:48.168757 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-394e917d-3036-4054-bf3c-3ef8c69b144e tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b01f24964a490da63d33097d0f9a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d957eb500948908f38f0f427a9017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:48.176223 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-394e917d-3036-4054-bf3c-3ef8c69b144e tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580" status: 200 len: 1358 microversion: 2.1 time: 0.142842 Aug 27 04:34:48.176787 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 257/506] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:34:48 2021] GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580 => generated 1358 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:48.971685 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-e55f9f67-13c5-4a69-974c-9850db47b95d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:48.972946 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-e55f9f67-13c5-4a69-974c-9850db47b95d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:48.978835 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e55f9f67-13c5-4a69-974c-9850db47b95d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:48.979312 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e55f9f67-13c5-4a69-974c-9850db47b95d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:48.980112 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e55f9f67-13c5-4a69-974c-9850db47b95d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:48.980555 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e55f9f67-13c5-4a69-974c-9850db47b95d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:49.100748 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-e55f9f67-13c5-4a69-974c-9850db47b95d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:49.109968 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-e55f9f67-13c5-4a69-974c-9850db47b95d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:49.111680 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-e55f9f67-13c5-4a69-974c-9850db47b95d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:49.113076 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-e55f9f67-13c5-4a69-974c-9850db47b95d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1724 microversion: 2.20 time: 0.145010 Aug 27 04:34:49.113724 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 250/507] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:34:48 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1724 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:34:49.192885 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-475ab8ef-db6c-40b2-80a1-e2f9545e663b tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:49.193493 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-475ab8ef-db6c-40b2-80a1-e2f9545e663b tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [instance: 89e425c1-0168-4f5d-8635-dd6b9f88c580] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:49.199735 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-475ab8ef-db6c-40b2-80a1-e2f9545e663b tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:49.200224 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-475ab8ef-db6c-40b2-80a1-e2f9545e663b tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:49.200983 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-475ab8ef-db6c-40b2-80a1-e2f9545e663b tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:49.201412 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-475ab8ef-db6c-40b2-80a1-e2f9545e663b tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:49.320446 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-475ab8ef-db6c-40b2-80a1-e2f9545e663b tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b01f24964a490da63d33097d0f9a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d957eb500948908f38f0f427a9017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:49.327718 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-475ab8ef-db6c-40b2-80a1-e2f9545e663b tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580" status: 200 len: 1358 microversion: 2.1 time: 0.138479 Aug 27 04:34:49.328313 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 258/508] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:34:49 2021] GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580 => generated 1358 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:49.682335 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-cd447fca-0a7e-4710-aea4-238d79f355b2 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:49.682877 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-cd447fca-0a7e-4710-aea4-238d79f355b2 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:49.688909 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-cd447fca-0a7e-4710-aea4-238d79f355b2 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:49.689368 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-cd447fca-0a7e-4710-aea4-238d79f355b2 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:49.690164 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-cd447fca-0a7e-4710-aea4-238d79f355b2 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:49.690608 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-cd447fca-0a7e-4710-aea4-238d79f355b2 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:49.818426 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-cd447fca-0a7e-4710-aea4-238d79f355b2 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:49.825709 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-cd447fca-0a7e-4710-aea4-238d79f355b2 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1515 microversion: 2.1 time: 0.147099 Aug 27 04:34:49.826268 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 251/509] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:34:49 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1515 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:49.842006 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-0e4eb03e-f32f-4bee-b276-efeadcd472e3 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9328bfc8-6924-4104-a547-533aa4493cae"}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:49.843120 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-0e4eb03e-f32f-4bee-b276-efeadcd472e3 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:49.849317 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0e4eb03e-f32f-4bee-b276-efeadcd472e3 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:49.849772 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0e4eb03e-f32f-4bee-b276-efeadcd472e3 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:49.850634 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0e4eb03e-f32f-4bee-b276-efeadcd472e3 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:49.851085 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0e4eb03e-f32f-4bee-b276-efeadcd472e3 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:50.132711 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-0e4eb03e-f32f-4bee-b276-efeadcd472e3 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "POST /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.294230 Aug 27 04:34:50.133330 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 259/510] 10.222.0.53 () {60 vars in 1323 bytes} [Fri Aug 27 04:34:49 2021] POST /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9/os-volume_attachments => generated 194 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:34:50.135557 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-f4b5ef36-cfbc-43db-a96f-c23536d8be19 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:50.136157 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-f4b5ef36-cfbc-43db-a96f-c23536d8be19 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:50.143366 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f4b5ef36-cfbc-43db-a96f-c23536d8be19 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:50.143829 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f4b5ef36-cfbc-43db-a96f-c23536d8be19 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:50.144672 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f4b5ef36-cfbc-43db-a96f-c23536d8be19 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:50.145151 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f4b5ef36-cfbc-43db-a96f-c23536d8be19 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:50.279785 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-f4b5ef36-cfbc-43db-a96f-c23536d8be19 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:50.288088 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-f4b5ef36-cfbc-43db-a96f-c23536d8be19 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:50.289887 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-f4b5ef36-cfbc-43db-a96f-c23536d8be19 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:50.291036 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-f4b5ef36-cfbc-43db-a96f-c23536d8be19 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1724 microversion: 2.20 time: 0.160210 Aug 27 04:34:50.291602 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 252/511] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:34:50 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:34:50.345034 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-fc7c2e60-a7fc-4740-8c5a-3d12fbc0ab26 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:50.345726 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-fc7c2e60-a7fc-4740-8c5a-3d12fbc0ab26 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [instance: 89e425c1-0168-4f5d-8635-dd6b9f88c580] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:50.353328 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-fc7c2e60-a7fc-4740-8c5a-3d12fbc0ab26 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:50.353773 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-fc7c2e60-a7fc-4740-8c5a-3d12fbc0ab26 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:50.354546 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-fc7c2e60-a7fc-4740-8c5a-3d12fbc0ab26 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:50.354981 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-fc7c2e60-a7fc-4740-8c5a-3d12fbc0ab26 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:50.482054 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-fc7c2e60-a7fc-4740-8c5a-3d12fbc0ab26 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b01f24964a490da63d33097d0f9a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d957eb500948908f38f0f427a9017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:50.489268 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-fc7c2e60-a7fc-4740-8c5a-3d12fbc0ab26 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580" status: 200 len: 1358 microversion: 2.1 time: 0.148281 Aug 27 04:34:50.489827 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 260/512] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:34:50 2021] GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:51.310419 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-b467d424-ea30-44d3-b484-fefba6530b4f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:51.311241 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-b467d424-ea30-44d3-b484-fefba6530b4f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:51.317783 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b467d424-ea30-44d3-b484-fefba6530b4f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:51.318228 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b467d424-ea30-44d3-b484-fefba6530b4f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:51.318985 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b467d424-ea30-44d3-b484-fefba6530b4f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:51.319416 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b467d424-ea30-44d3-b484-fefba6530b4f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:51.444674 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-b467d424-ea30-44d3-b484-fefba6530b4f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:51.453179 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-b467d424-ea30-44d3-b484-fefba6530b4f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:51.454848 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-b467d424-ea30-44d3-b484-fefba6530b4f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:51.456146 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-b467d424-ea30-44d3-b484-fefba6530b4f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1724 microversion: 2.20 time: 0.150185 Aug 27 04:34:51.456800 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 253/513] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:34:51 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:34:51.506542 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-f22d4abd-159d-4356-99a3-9b283c8c217a tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:51.507155 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-f22d4abd-159d-4356-99a3-9b283c8c217a tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [instance: 89e425c1-0168-4f5d-8635-dd6b9f88c580] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:51.513443 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f22d4abd-159d-4356-99a3-9b283c8c217a tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:51.513892 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f22d4abd-159d-4356-99a3-9b283c8c217a tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:51.514665 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f22d4abd-159d-4356-99a3-9b283c8c217a tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:51.515101 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f22d4abd-159d-4356-99a3-9b283c8c217a tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:51.634635 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-f22d4abd-159d-4356-99a3-9b283c8c217a tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b01f24964a490da63d33097d0f9a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d957eb500948908f38f0f427a9017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:51.641861 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-f22d4abd-159d-4356-99a3-9b283c8c217a tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580" status: 200 len: 1358 microversion: 2.1 time: 0.139511 Aug 27 04:34:51.642428 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 261/514] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:34:51 2021] GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580 => generated 1358 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:52.475156 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-370d9131-e5e2-44f6-99e2-fb294490ca92 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:52.475771 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-370d9131-e5e2-44f6-99e2-fb294490ca92 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:52.497781 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-370d9131-e5e2-44f6-99e2-fb294490ca92 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:52.498255 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-370d9131-e5e2-44f6-99e2-fb294490ca92 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:52.499024 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-370d9131-e5e2-44f6-99e2-fb294490ca92 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:52.499463 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-370d9131-e5e2-44f6-99e2-fb294490ca92 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:52.646442 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-370d9131-e5e2-44f6-99e2-fb294490ca92 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:52.660116 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-a38a89bc-9d01-4729-b131-e166b469d898 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:52.662842 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-370d9131-e5e2-44f6-99e2-fb294490ca92 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:52.664381 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-370d9131-e5e2-44f6-99e2-fb294490ca92 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:52.665382 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-a38a89bc-9d01-4729-b131-e166b469d898 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [instance: 89e425c1-0168-4f5d-8635-dd6b9f88c580] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:52.665545 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-370d9131-e5e2-44f6-99e2-fb294490ca92 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1724 microversion: 2.20 time: 0.194642 Aug 27 04:34:52.666642 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 254/515] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:34:52 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:34:52.673479 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a38a89bc-9d01-4729-b131-e166b469d898 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:52.674262 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a38a89bc-9d01-4729-b131-e166b469d898 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:52.675192 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a38a89bc-9d01-4729-b131-e166b469d898 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:52.675730 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a38a89bc-9d01-4729-b131-e166b469d898 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:52.682123 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-6da632e2-80c0-4866-bdce-c73cf913dacb tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:52.690658 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6da632e2-80c0-4866-bdce-c73cf913dacb tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:52.691763 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6da632e2-80c0-4866-bdce-c73cf913dacb tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:52.772566 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-6da632e2-80c0-4866-bdce-c73cf913dacb tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Going to try to stop instance {{(pid=108970) force_stop /opt/stack/nova/nova/compute/api.py:2615}} Aug 27 04:34:52.824325 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-a38a89bc-9d01-4729-b131-e166b469d898 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b01f24964a490da63d33097d0f9a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d957eb500948908f38f0f427a9017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:52.834129 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-a38a89bc-9d01-4729-b131-e166b469d898 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580" status: 200 len: 1358 microversion: 2.1 time: 0.179362 Aug 27 04:34:52.834796 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 262/516] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:34:52 2021] GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:34:52.846172 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-6da632e2-80c0-4866-bdce-c73cf913dacb tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 202 len: 0 microversion: 2.1 time: 0.177618 Aug 27 04:34:52.846875 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 255/517] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:34:52 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:34:52.856971 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-56076bbb-0763-4ffc-bc58-f4b8a3cdf864 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:52.858176 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-56076bbb-0763-4ffc-bc58-f4b8a3cdf864 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:52.865195 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-56076bbb-0763-4ffc-bc58-f4b8a3cdf864 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:52.866268 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-56076bbb-0763-4ffc-bc58-f4b8a3cdf864 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:52.867412 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-56076bbb-0763-4ffc-bc58-f4b8a3cdf864 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:52.868612 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-56076bbb-0763-4ffc-bc58-f4b8a3cdf864 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:52.889510 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [req-0ae93497-b25f-40e1-8dfd-73a981c94a11 req-88d7d3cb-3544-49fa-905e-f7bb955cc6ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89e425c1-0168-4f5d-8635-dd6b9f88c580", "name": "network-vif-plugged", "status": "completed", "tag": "6348fecd-7464-4987-a099-9e9f7e860b0c"}]} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:34:52.891857 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:34:52.891857 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: warnings.warn(msg) Aug 27 04:34:52.902533 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-0ae93497-b25f-40e1-8dfd-73a981c94a11 req-88d7d3cb-3544-49fa-905e-f7bb955cc6ac service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:52.903268 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-0ae93497-b25f-40e1-8dfd-73a981c94a11 req-88d7d3cb-3544-49fa-905e-f7bb955cc6ac service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:52.915491 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.compute.server_external_events [req-0ae93497-b25f-40e1-8dfd-73a981c94a11 req-88d7d3cb-3544-49fa-905e-f7bb955cc6ac service nova] Creating event network-vif-plugged:6348fecd-7464-4987-a099-9e9f7e860b0c for instance 89e425c1-0168-4f5d-8635-dd6b9f88c580 on hv-cinder-80403 Aug 27 04:34:52.923093 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [req-0ae93497-b25f-40e1-8dfd-73a981c94a11 req-88d7d3cb-3544-49fa-905e-f7bb955cc6ac service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037860 Aug 27 04:34:52.923694 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 256/518] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:34:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:34:53.014545 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-56076bbb-0763-4ffc-bc58-f4b8a3cdf864 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:53.023751 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-56076bbb-0763-4ffc-bc58-f4b8a3cdf864 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1724 microversion: 2.1 time: 0.170258 Aug 27 04:34:53.024487 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 263/519] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:34:52 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:53.686869 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-0d3aa669-7a7f-4c29-8828-ac5f5f8de675 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:53.687693 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-0d3aa669-7a7f-4c29-8828-ac5f5f8de675 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:53.694877 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0d3aa669-7a7f-4c29-8828-ac5f5f8de675 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:53.695684 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0d3aa669-7a7f-4c29-8828-ac5f5f8de675 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:53.696777 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0d3aa669-7a7f-4c29-8828-ac5f5f8de675 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:53.697428 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0d3aa669-7a7f-4c29-8828-ac5f5f8de675 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:53.851154 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-7c5632b7-6219-449e-9f7a-e044437fe221 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:53.855128 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-0d3aa669-7a7f-4c29-8828-ac5f5f8de675 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:53.859086 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-7c5632b7-6219-449e-9f7a-e044437fe221 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [instance: 89e425c1-0168-4f5d-8635-dd6b9f88c580] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:53.867247 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7c5632b7-6219-449e-9f7a-e044437fe221 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:53.867536 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-0d3aa669-7a7f-4c29-8828-ac5f5f8de675 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:53.868271 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7c5632b7-6219-449e-9f7a-e044437fe221 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:53.869296 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7c5632b7-6219-449e-9f7a-e044437fe221 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:53.869852 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-0d3aa669-7a7f-4c29-8828-ac5f5f8de675 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:53.870446 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7c5632b7-6219-449e-9f7a-e044437fe221 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:53.871349 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-0d3aa669-7a7f-4c29-8828-ac5f5f8de675 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1724 microversion: 2.20 time: 0.189311 Aug 27 04:34:53.871925 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 257/520] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:34:53 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:34:54.042213 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-27611d32-5e2d-43de-b744-9ce6823e95ea tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:54.042965 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-27611d32-5e2d-43de-b744-9ce6823e95ea tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:54.048893 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-27611d32-5e2d-43de-b744-9ce6823e95ea tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:54.049254 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-27611d32-5e2d-43de-b744-9ce6823e95ea tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:54.050982 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-27611d32-5e2d-43de-b744-9ce6823e95ea tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:54.051323 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-27611d32-5e2d-43de-b744-9ce6823e95ea tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:54.074069 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-7c5632b7-6219-449e-9f7a-e044437fe221 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b01f24964a490da63d33097d0f9a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d957eb500948908f38f0f427a9017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:54.082068 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-7c5632b7-6219-449e-9f7a-e044437fe221 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580" status: 200 len: 1358 microversion: 2.1 time: 0.234919 Aug 27 04:34:54.082715 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 264/521] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:34:53 2021] GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580 => generated 1358 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:34:54.207082 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-27611d32-5e2d-43de-b744-9ce6823e95ea tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:54.216563 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-27611d32-5e2d-43de-b744-9ce6823e95ea tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1724 microversion: 2.1 time: 0.177860 Aug 27 04:34:54.217364 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 258/522] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:34:54 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:34:54.894640 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-d12b0f7e-f752-4173-a416-f4ce52b3bf3d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:54.895402 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-d12b0f7e-f752-4173-a416-f4ce52b3bf3d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:54.901673 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d12b0f7e-f752-4173-a416-f4ce52b3bf3d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:54.902123 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d12b0f7e-f752-4173-a416-f4ce52b3bf3d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:54.902956 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d12b0f7e-f752-4173-a416-f4ce52b3bf3d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:54.903338 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d12b0f7e-f752-4173-a416-f4ce52b3bf3d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:55.099105 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-193c35dd-7d69-414e-8571-981b73d1e965 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:55.099851 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-193c35dd-7d69-414e-8571-981b73d1e965 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [instance: 89e425c1-0168-4f5d-8635-dd6b9f88c580] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:55.108989 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-193c35dd-7d69-414e-8571-981b73d1e965 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:55.109478 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-193c35dd-7d69-414e-8571-981b73d1e965 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:55.110352 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-193c35dd-7d69-414e-8571-981b73d1e965 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:55.110812 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-193c35dd-7d69-414e-8571-981b73d1e965 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:55.177477 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-d12b0f7e-f752-4173-a416-f4ce52b3bf3d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:55.186503 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-d12b0f7e-f752-4173-a416-f4ce52b3bf3d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:55.188546 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-d12b0f7e-f752-4173-a416-f4ce52b3bf3d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:55.190014 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-d12b0f7e-f752-4173-a416-f4ce52b3bf3d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1724 microversion: 2.20 time: 0.303615 Aug 27 04:34:55.191508 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 265/523] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:34:54 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1724 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:34:55.234900 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-7930b4fd-6e79-4f9d-a1c4-899009e7c29e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:55.235554 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-7930b4fd-6e79-4f9d-a1c4-899009e7c29e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:55.242324 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7930b4fd-6e79-4f9d-a1c4-899009e7c29e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:55.243216 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7930b4fd-6e79-4f9d-a1c4-899009e7c29e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:55.243951 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7930b4fd-6e79-4f9d-a1c4-899009e7c29e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:55.244429 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7930b4fd-6e79-4f9d-a1c4-899009e7c29e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:55.271530 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-193c35dd-7d69-414e-8571-981b73d1e965 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b01f24964a490da63d33097d0f9a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d957eb500948908f38f0f427a9017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:55.280910 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-193c35dd-7d69-414e-8571-981b73d1e965 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580" status: 200 len: 1358 microversion: 2.1 time: 0.185908 Aug 27 04:34:55.282067 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 259/524] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:34:55 2021] GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580 => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:34:55.663657 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-7930b4fd-6e79-4f9d-a1c4-899009e7c29e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:55.675075 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-7930b4fd-6e79-4f9d-a1c4-899009e7c29e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1724 microversion: 2.1 time: 0.444039 Aug 27 04:34:55.676473 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 266/525] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:34:55 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1724 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:34:56.209593 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-13ee6b11-7598-4182-8074-8e00a1b0e15c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:56.211135 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-13ee6b11-7598-4182-8074-8e00a1b0e15c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:56.217852 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-13ee6b11-7598-4182-8074-8e00a1b0e15c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:56.218626 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-13ee6b11-7598-4182-8074-8e00a1b0e15c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:56.219690 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-13ee6b11-7598-4182-8074-8e00a1b0e15c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:56.220397 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-13ee6b11-7598-4182-8074-8e00a1b0e15c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:56.299371 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-41866ea7-3cb1-4891-a5a9-abdde4f819d2 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:56.301157 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-41866ea7-3cb1-4891-a5a9-abdde4f819d2 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [instance: 89e425c1-0168-4f5d-8635-dd6b9f88c580] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:56.307930 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-41866ea7-3cb1-4891-a5a9-abdde4f819d2 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:56.309546 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-41866ea7-3cb1-4891-a5a9-abdde4f819d2 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:56.311609 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-41866ea7-3cb1-4891-a5a9-abdde4f819d2 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:56.312894 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-41866ea7-3cb1-4891-a5a9-abdde4f819d2 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:56.438711 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-13ee6b11-7598-4182-8074-8e00a1b0e15c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:56.447653 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-13ee6b11-7598-4182-8074-8e00a1b0e15c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:56.449188 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-13ee6b11-7598-4182-8074-8e00a1b0e15c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:56.456328 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-13ee6b11-7598-4182-8074-8e00a1b0e15c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1724 microversion: 2.20 time: 0.250982 Aug 27 04:34:56.459804 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 260/526] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:34:56 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1724 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:34:56.553805 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-41866ea7-3cb1-4891-a5a9-abdde4f819d2 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b01f24964a490da63d33097d0f9a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d957eb500948908f38f0f427a9017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:56.561214 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-41866ea7-3cb1-4891-a5a9-abdde4f819d2 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580" status: 200 len: 1548 microversion: 2.1 time: 0.266211 Aug 27 04:34:56.579681 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-023591aa-1e69-4bc1-b522-5b5c70b45904 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:56.580885 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-023591aa-1e69-4bc1-b522-5b5c70b45904 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [instance: 89e425c1-0168-4f5d-8635-dd6b9f88c580] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:56.586414 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 267/527] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:34:56 2021] GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580 => generated 1548 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:56.589240 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-023591aa-1e69-4bc1-b522-5b5c70b45904 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:56.589629 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-023591aa-1e69-4bc1-b522-5b5c70b45904 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:56.590855 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-023591aa-1e69-4bc1-b522-5b5c70b45904 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:56.591291 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-023591aa-1e69-4bc1-b522-5b5c70b45904 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:56.694500 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-cb669132-0cac-4188-8f79-b420f02f8dcc tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:56.695187 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-cb669132-0cac-4188-8f79-b420f02f8dcc tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:56.701860 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cb669132-0cac-4188-8f79-b420f02f8dcc tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:56.702578 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cb669132-0cac-4188-8f79-b420f02f8dcc tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:56.703837 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cb669132-0cac-4188-8f79-b420f02f8dcc tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:56.704705 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cb669132-0cac-4188-8f79-b420f02f8dcc tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:56.824039 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-023591aa-1e69-4bc1-b522-5b5c70b45904 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b01f24964a490da63d33097d0f9a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d957eb500948908f38f0f427a9017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:56.835671 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-023591aa-1e69-4bc1-b522-5b5c70b45904 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580" status: 200 len: 1548 microversion: 2.1 time: 0.260472 Aug 27 04:34:56.837636 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 261/528] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:34:56 2021] GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580 => generated 1548 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:56.852789 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-b75a6720-7839-439e-8b5f-f509db515283 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:56.856146 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:34:56.856146 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: warnings.warn(msg) Aug 27 04:34:56.857149 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-b75a6720-7839-439e-8b5f-f509db515283 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '09b01f24964a490da63d33097d0f9a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d957eb500948908f38f0f427a9017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:56.858096 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-b75a6720-7839-439e-8b5f-f509db515283 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Searching by: {'deleted': False, 'project_id': 'c4d957eb500948908f38f0f427a9017b'} {{(pid=108970) get_all /opt/stack/nova/nova/compute/api.py:2868}} Aug 27 04:34:56.861237 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-cb669132-0cac-4188-8f79-b420f02f8dcc tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:56.874212 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b75a6720-7839-439e-8b5f-f509db515283 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:56.875437 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b75a6720-7839-439e-8b5f-f509db515283 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:56.876642 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b75a6720-7839-439e-8b5f-f509db515283 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:56.877258 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b75a6720-7839-439e-8b5f-f509db515283 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:56.881857 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-cb669132-0cac-4188-8f79-b420f02f8dcc tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1724 microversion: 2.1 time: 0.192051 Aug 27 04:34:56.883519 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 268/529] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:34:56 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1724 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:34:56.982893 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.multi_cell_list [None req-b75a6720-7839-439e-8b5f-f509db515283 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=108970) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Aug 27 04:34:57.119360 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-b75a6720-7839-439e-8b5f-f509db515283 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.269945 Aug 27 04:34:57.120026 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 262/530] 10.222.0.53 () {58 vars in 1125 bytes} [Fri Aug 27 04:34:56 2021] GET /compute/v2.1/servers => generated 342 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:34:57.130734 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-f6ff565e-e389-4e0c-b60a-eeb6ab576186 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:57.131411 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-f6ff565e-e389-4e0c-b60a-eeb6ab576186 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [instance: 89e425c1-0168-4f5d-8635-dd6b9f88c580] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:57.137509 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f6ff565e-e389-4e0c-b60a-eeb6ab576186 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:57.137949 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f6ff565e-e389-4e0c-b60a-eeb6ab576186 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:57.138862 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f6ff565e-e389-4e0c-b60a-eeb6ab576186 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:57.139297 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f6ff565e-e389-4e0c-b60a-eeb6ab576186 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:57.294283 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-f6ff565e-e389-4e0c-b60a-eeb6ab576186 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b01f24964a490da63d33097d0f9a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d957eb500948908f38f0f427a9017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:57.304313 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-f6ff565e-e389-4e0c-b60a-eeb6ab576186 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580" status: 200 len: 1548 microversion: 2.1 time: 0.177710 Aug 27 04:34:57.318233 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 269/531] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:34:57 2021] GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580 => generated 1548 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:57.474501 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-f007465a-751c-4c66-a822-8b5f0e7bde10 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:57.475119 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-f007465a-751c-4c66-a822-8b5f0e7bde10 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:57.482983 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f007465a-751c-4c66-a822-8b5f0e7bde10 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:57.484032 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f007465a-751c-4c66-a822-8b5f0e7bde10 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:57.485145 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f007465a-751c-4c66-a822-8b5f0e7bde10 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:57.485594 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f007465a-751c-4c66-a822-8b5f0e7bde10 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:57.830473 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-f007465a-751c-4c66-a822-8b5f0e7bde10 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:57.839630 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-f007465a-751c-4c66-a822-8b5f0e7bde10 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:57.841328 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-f007465a-751c-4c66-a822-8b5f0e7bde10 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:57.843034 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-f007465a-751c-4c66-a822-8b5f0e7bde10 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1724 microversion: 2.20 time: 0.372194 Aug 27 04:34:57.843813 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 263/532] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:34:57 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1724 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:34:57.901204 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-5282b9be-3f01-482d-a002-dd9f70f0a947 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:57.901913 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-5282b9be-3f01-482d-a002-dd9f70f0a947 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:57.919817 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5282b9be-3f01-482d-a002-dd9f70f0a947 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:57.920401 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5282b9be-3f01-482d-a002-dd9f70f0a947 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:57.921319 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5282b9be-3f01-482d-a002-dd9f70f0a947 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:57.921817 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5282b9be-3f01-482d-a002-dd9f70f0a947 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:58.106331 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-5282b9be-3f01-482d-a002-dd9f70f0a947 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:58.119455 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-5282b9be-3f01-482d-a002-dd9f70f0a947 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1724 microversion: 2.1 time: 0.223580 Aug 27 04:34:58.120727 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 270/533] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:34:57 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1724 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:34:58.864229 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-8997f2e2-8b26-4b38-95dc-91e37d64ac62 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:58.864829 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-8997f2e2-8b26-4b38-95dc-91e37d64ac62 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:58.871480 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-8997f2e2-8b26-4b38-95dc-91e37d64ac62 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:58.872239 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-8997f2e2-8b26-4b38-95dc-91e37d64ac62 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:58.873081 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-8997f2e2-8b26-4b38-95dc-91e37d64ac62 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:58.873678 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-8997f2e2-8b26-4b38-95dc-91e37d64ac62 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:59.080442 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-8997f2e2-8b26-4b38-95dc-91e37d64ac62 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:59.090065 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-8997f2e2-8b26-4b38-95dc-91e37d64ac62 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:59.091607 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-8997f2e2-8b26-4b38-95dc-91e37d64ac62 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:59.092928 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-8997f2e2-8b26-4b38-95dc-91e37d64ac62 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1724 microversion: 2.20 time: 0.234181 Aug 27 04:34:59.093477 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 264/534] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:34:58 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1724 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:34:59.137729 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-82cb1e2f-3995-48a8-99a3-95d46215a6f5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:34:59.138460 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-82cb1e2f-3995-48a8-99a3-95d46215a6f5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:34:59.145043 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-82cb1e2f-3995-48a8-99a3-95d46215a6f5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:59.145667 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-82cb1e2f-3995-48a8-99a3-95d46215a6f5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:59.147328 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-82cb1e2f-3995-48a8-99a3-95d46215a6f5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:34:59.148455 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-82cb1e2f-3995-48a8-99a3-95d46215a6f5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:34:59.291369 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-82cb1e2f-3995-48a8-99a3-95d46215a6f5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:34:59.299765 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-82cb1e2f-3995-48a8-99a3-95d46215a6f5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1724 microversion: 2.1 time: 0.166092 Aug 27 04:34:59.305257 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 271/535] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:34:59 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:00.125902 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-6e1b3bb4-7b87-414e-90d4-58263b7f3ce3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:00.127255 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-6e1b3bb4-7b87-414e-90d4-58263b7f3ce3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:00.139927 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6e1b3bb4-7b87-414e-90d4-58263b7f3ce3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:00.140870 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6e1b3bb4-7b87-414e-90d4-58263b7f3ce3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:00.142216 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6e1b3bb4-7b87-414e-90d4-58263b7f3ce3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:00.142931 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6e1b3bb4-7b87-414e-90d4-58263b7f3ce3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:00.188311 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-54351701-87ca-4834-9e1c-9d1663b1534e tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5e03692b-d9f6-4291-82a2-9a57cfc1cb67"}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:00.189633 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-54351701-87ca-4834-9e1c-9d1663b1534e tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [instance: 89e425c1-0168-4f5d-8635-dd6b9f88c580] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:00.196904 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-54351701-87ca-4834-9e1c-9d1663b1534e tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:00.198038 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-54351701-87ca-4834-9e1c-9d1663b1534e tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:00.199326 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-54351701-87ca-4834-9e1c-9d1663b1534e tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:00.200001 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-54351701-87ca-4834-9e1c-9d1663b1534e tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:00.545064 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-54351701-87ca-4834-9e1c-9d1663b1534e tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "POST /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.363682 Aug 27 04:35:00.546327 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 272/536] 10.222.0.53 () {60 vars in 1323 bytes} [Fri Aug 27 04:35:00 2021] POST /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580/os-volume_attachments => generated 194 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:35:00.553355 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-9b47e548-e4c5-4d2b-9fb1-71676a328379 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:00.554529 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-9b47e548-e4c5-4d2b-9fb1-71676a328379 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:00.576024 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9b47e548-e4c5-4d2b-9fb1-71676a328379 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:00.577258 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9b47e548-e4c5-4d2b-9fb1-71676a328379 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:00.580964 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9b47e548-e4c5-4d2b-9fb1-71676a328379 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:00.583653 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9b47e548-e4c5-4d2b-9fb1-71676a328379 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:00.689509 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-6e1b3bb4-7b87-414e-90d4-58263b7f3ce3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:00.701638 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-6e1b3bb4-7b87-414e-90d4-58263b7f3ce3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:00.705338 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-6e1b3bb4-7b87-414e-90d4-58263b7f3ce3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:00.710009 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-6e1b3bb4-7b87-414e-90d4-58263b7f3ce3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1724 microversion: 2.20 time: 0.591612 Aug 27 04:35:00.723890 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 265/537] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:35:00 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1724 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:00.790935 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-9b47e548-e4c5-4d2b-9fb1-71676a328379 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:00.800886 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-9b47e548-e4c5-4d2b-9fb1-71676a328379 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1724 microversion: 2.1 time: 0.252308 Aug 27 04:35:00.813006 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 273/538] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:00 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1724 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:01.059022 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-bfd1d41c-18c0-468f-9966-d76649de9c85 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:01.059962 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-bfd1d41c-18c0-468f-9966-d76649de9c85 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:01.066860 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-bfd1d41c-18c0-468f-9966-d76649de9c85 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:01.066860 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-bfd1d41c-18c0-468f-9966-d76649de9c85 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:01.067610 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-bfd1d41c-18c0-468f-9966-d76649de9c85 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:01.068088 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-bfd1d41c-18c0-468f-9966-d76649de9c85 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:01.096573 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.objects.instance [None req-bfd1d41c-18c0-468f-9966-d76649de9c85 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lazy-loading 'flavor' on Instance uuid 0e594817-f3cc-40e6-babe-c736641fb9a9 {{(pid=108970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:35:01.240005 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-bfd1d41c-18c0-468f-9966-d76649de9c85 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "POST /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9/action" status: 200 len: 32 microversion: 2.1 time: 0.185385 Aug 27 04:35:01.240972 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 266/539] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:35:01 2021] POST /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9/action => generated 32 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:35:01.250215 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-9e704b10-fb94-4875-8b1f-117085e60a98 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:01.250834 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-9e704b10-fb94-4875-8b1f-117085e60a98 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:01.259591 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9e704b10-fb94-4875-8b1f-117085e60a98 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:01.260062 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9e704b10-fb94-4875-8b1f-117085e60a98 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:01.260855 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9e704b10-fb94-4875-8b1f-117085e60a98 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:01.261289 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9e704b10-fb94-4875-8b1f-117085e60a98 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:01.542923 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-9e704b10-fb94-4875-8b1f-117085e60a98 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:01.575710 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-9e704b10-fb94-4875-8b1f-117085e60a98 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1567 microversion: 2.1 time: 0.327368 Aug 27 04:35:01.578484 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 274/540] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:01 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1567 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:01.733941 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-d8633729-5add-477a-ad03-f3338ca58d72 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:01.734780 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-d8633729-5add-477a-ad03-f3338ca58d72 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:01.754734 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d8633729-5add-477a-ad03-f3338ca58d72 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:01.758303 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d8633729-5add-477a-ad03-f3338ca58d72 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:01.760926 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d8633729-5add-477a-ad03-f3338ca58d72 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:01.773721 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d8633729-5add-477a-ad03-f3338ca58d72 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:01.820043 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-51a1c344-a43f-494d-b0e9-251fa6033ee5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:01.820043 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-51a1c344-a43f-494d-b0e9-251fa6033ee5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:01.833646 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-51a1c344-a43f-494d-b0e9-251fa6033ee5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:01.834098 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-51a1c344-a43f-494d-b0e9-251fa6033ee5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:01.834884 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-51a1c344-a43f-494d-b0e9-251fa6033ee5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:01.835316 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-51a1c344-a43f-494d-b0e9-251fa6033ee5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:02.054521 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-d8633729-5add-477a-ad03-f3338ca58d72 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:02.062773 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-d8633729-5add-477a-ad03-f3338ca58d72 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:02.064326 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-d8633729-5add-477a-ad03-f3338ca58d72 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:02.069381 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-d8633729-5add-477a-ad03-f3338ca58d72 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1745 microversion: 2.20 time: 0.342412 Aug 27 04:35:02.074747 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 267/541] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:35:01 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1745 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:02.106439 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-51a1c344-a43f-494d-b0e9-251fa6033ee5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:02.115640 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-51a1c344-a43f-494d-b0e9-251fa6033ee5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1724 microversion: 2.1 time: 0.300516 Aug 27 04:35:02.119185 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 275/542] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:01 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1724 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:02.605095 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-2cb86518-0bfb-45f4-a6b8-71720d4d563f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:02.605643 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-2cb86518-0bfb-45f4-a6b8-71720d4d563f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:02.616737 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2cb86518-0bfb-45f4-a6b8-71720d4d563f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:02.617597 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2cb86518-0bfb-45f4-a6b8-71720d4d563f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:02.618831 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2cb86518-0bfb-45f4-a6b8-71720d4d563f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:02.619494 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2cb86518-0bfb-45f4-a6b8-71720d4d563f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:02.871438 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-2cb86518-0bfb-45f4-a6b8-71720d4d563f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:02.893719 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-2cb86518-0bfb-45f4-a6b8-71720d4d563f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1567 microversion: 2.1 time: 0.292482 Aug 27 04:35:02.896068 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 268/543] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:02 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1567 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:03.098904 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-da0a0e1c-bf76-45a3-a116-eaa3a998bc8d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:03.100686 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-da0a0e1c-bf76-45a3-a116-eaa3a998bc8d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:03.123167 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-da0a0e1c-bf76-45a3-a116-eaa3a998bc8d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:03.127496 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-da0a0e1c-bf76-45a3-a116-eaa3a998bc8d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:03.135951 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-a9922301-1200-43df-b85b-ddf2cc1ef40e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:03.137429 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-a9922301-1200-43df-b85b-ddf2cc1ef40e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:03.147745 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-da0a0e1c-bf76-45a3-a116-eaa3a998bc8d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:03.148778 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-da0a0e1c-bf76-45a3-a116-eaa3a998bc8d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:03.179108 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a9922301-1200-43df-b85b-ddf2cc1ef40e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:03.180125 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a9922301-1200-43df-b85b-ddf2cc1ef40e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:03.185391 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a9922301-1200-43df-b85b-ddf2cc1ef40e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:03.186300 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a9922301-1200-43df-b85b-ddf2cc1ef40e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:03.453418 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-da0a0e1c-bf76-45a3-a116-eaa3a998bc8d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:03.469227 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-da0a0e1c-bf76-45a3-a116-eaa3a998bc8d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:03.474283 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-da0a0e1c-bf76-45a3-a116-eaa3a998bc8d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:03.477124 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-da0a0e1c-bf76-45a3-a116-eaa3a998bc8d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1745 microversion: 2.20 time: 0.385015 Aug 27 04:35:03.494691 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 276/544] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:35:03 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1745 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:03.589631 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-a9922301-1200-43df-b85b-ddf2cc1ef40e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:03.601134 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-a9922301-1200-43df-b85b-ddf2cc1ef40e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1724 microversion: 2.1 time: 0.470721 Aug 27 04:35:03.611787 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 269/545] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:03 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1724 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:35:03.918040 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-1c17a204-c6bd-48b7-b40f-1d3acd9513f2 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:03.918676 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-1c17a204-c6bd-48b7-b40f-1d3acd9513f2 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:03.925153 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1c17a204-c6bd-48b7-b40f-1d3acd9513f2 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:03.931611 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1c17a204-c6bd-48b7-b40f-1d3acd9513f2 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:03.932734 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1c17a204-c6bd-48b7-b40f-1d3acd9513f2 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:03.935833 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1c17a204-c6bd-48b7-b40f-1d3acd9513f2 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:04.207595 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-1c17a204-c6bd-48b7-b40f-1d3acd9513f2 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:04.215664 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-1c17a204-c6bd-48b7-b40f-1d3acd9513f2 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1567 microversion: 2.1 time: 0.308112 Aug 27 04:35:04.217437 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 277/546] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:03 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1567 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:04.497333 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-6d8d643a-42c3-4202-8515-448eb7bbe137 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:04.498131 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-6d8d643a-42c3-4202-8515-448eb7bbe137 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:04.514467 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6d8d643a-42c3-4202-8515-448eb7bbe137 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:04.515066 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6d8d643a-42c3-4202-8515-448eb7bbe137 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:04.516570 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6d8d643a-42c3-4202-8515-448eb7bbe137 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:04.518003 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6d8d643a-42c3-4202-8515-448eb7bbe137 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:04.641636 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-63e26db4-4c54-4f70-a10d-691840fd9dd3 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:04.642530 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-63e26db4-4c54-4f70-a10d-691840fd9dd3 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:04.650445 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-63e26db4-4c54-4f70-a10d-691840fd9dd3 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:04.651065 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-63e26db4-4c54-4f70-a10d-691840fd9dd3 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:04.652046 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-63e26db4-4c54-4f70-a10d-691840fd9dd3 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:04.652677 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-63e26db4-4c54-4f70-a10d-691840fd9dd3 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:04.688312 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-6d8d643a-42c3-4202-8515-448eb7bbe137 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:04.699669 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-6d8d643a-42c3-4202-8515-448eb7bbe137 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:04.701581 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-6d8d643a-42c3-4202-8515-448eb7bbe137 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:04.702769 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-6d8d643a-42c3-4202-8515-448eb7bbe137 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1745 microversion: 2.20 time: 0.211594 Aug 27 04:35:04.714211 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 270/547] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:35:04 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1745 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:04.817787 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-63e26db4-4c54-4f70-a10d-691840fd9dd3 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:04.828147 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-63e26db4-4c54-4f70-a10d-691840fd9dd3 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1724 microversion: 2.1 time: 0.191129 Aug 27 04:35:04.840650 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 278/548] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:04 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1724 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:04.977278 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-57f00532-b91f-4442-b26c-be5fbab193ac tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Action: 'create', calling method: .version_select at 0x7f207818cca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-305484201"}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:05.004781 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.quota [None req-57f00532-b91f-4442-b26c-be5fbab193ac tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Getting quotas for project a4c45e6a7cab4d2db5a499b8f2323e6a. Resources: {'key_pairs'} {{(pid=108970) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:35:05.026555 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.quota [None req-57f00532-b91f-4442-b26c-be5fbab193ac tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Getting quotas for user 74221dde8a0048af90dd03d8132aa68f and project a4c45e6a7cab4d2db5a499b8f2323e6a. Resources: {'key_pairs'} {{(pid=108970) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:35:05.232224 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [req-2dad94fb-a925-486a-a5d5-d526a553e78a req-93b6ccb7-e609-4bd6-b834-e926d43bc3e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3173859-725e-4d66-80af-4223a6643935", "name": "network-vif-plugged", "status": "completed", "tag": "698af269-46a5-4892-822b-9ef4aa21fa2e"}]} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:05.236777 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:35:05.236777 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: warnings.warn(msg) Aug 27 04:35:05.264526 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-2dad94fb-a925-486a-a5d5-d526a553e78a req-93b6ccb7-e609-4bd6-b834-e926d43bc3e9 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:05.265438 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-2dad94fb-a925-486a-a5d5-d526a553e78a req-93b6ccb7-e609-4bd6-b834-e926d43bc3e9 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:05.310142 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.compute.server_external_events [req-2dad94fb-a925-486a-a5d5-d526a553e78a req-93b6ccb7-e609-4bd6-b834-e926d43bc3e9 service nova] Creating event network-vif-plugged:698af269-46a5-4892-822b-9ef4aa21fa2e for instance b3173859-725e-4d66-80af-4223a6643935 on hv-cinder-80403 Aug 27 04:35:05.320902 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [req-2dad94fb-a925-486a-a5d5-d526a553e78a req-93b6ccb7-e609-4bd6-b834-e926d43bc3e9 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101889 Aug 27 04:35:05.322706 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 279/549] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:35:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:35:05.333049 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-f7e1d36e-874d-4216-8b76-8efd23c39ec0 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:05.334736 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-f7e1d36e-874d-4216-8b76-8efd23c39ec0 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:05.346063 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f7e1d36e-874d-4216-8b76-8efd23c39ec0 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:05.347211 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f7e1d36e-874d-4216-8b76-8efd23c39ec0 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:05.349723 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f7e1d36e-874d-4216-8b76-8efd23c39ec0 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:05.351216 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f7e1d36e-874d-4216-8b76-8efd23c39ec0 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:05.373499 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.quota [None req-57f00532-b91f-4442-b26c-be5fbab193ac tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Getting quotas for project a4c45e6a7cab4d2db5a499b8f2323e6a. Resources: {'key_pairs'} {{(pid=108970) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:35:05.377732 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.quota [None req-57f00532-b91f-4442-b26c-be5fbab193ac tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Getting quotas for user 74221dde8a0048af90dd03d8132aa68f and project a4c45e6a7cab4d2db5a499b8f2323e6a. Resources: {'key_pairs'} {{(pid=108970) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:35:05.392140 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-57f00532-b91f-4442-b26c-be5fbab193ac tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.639192 Aug 27 04:35:05.396157 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 271/550] 10.222.0.53 () {60 vars in 1158 bytes} [Fri Aug 27 04:35:04 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:05.629428 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-f7e1d36e-874d-4216-8b76-8efd23c39ec0 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:05.638008 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-f7e1d36e-874d-4216-8b76-8efd23c39ec0 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1567 microversion: 2.1 time: 0.312482 Aug 27 04:35:05.638583 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 280/551] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:05 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1567 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:05.720294 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-edf9b0b9-6592-40e8-9a17-779824ea10e3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:05.720904 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-edf9b0b9-6592-40e8-9a17-779824ea10e3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:05.727470 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-edf9b0b9-6592-40e8-9a17-779824ea10e3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:05.727974 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-edf9b0b9-6592-40e8-9a17-779824ea10e3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:05.728879 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-edf9b0b9-6592-40e8-9a17-779824ea10e3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:05.729615 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-edf9b0b9-6592-40e8-9a17-779824ea10e3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:05.847224 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-d725c55a-ef51-46c9-a02d-e530b5289a4e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:05.848340 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-d725c55a-ef51-46c9-a02d-e530b5289a4e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:05.854768 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d725c55a-ef51-46c9-a02d-e530b5289a4e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:05.855336 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d725c55a-ef51-46c9-a02d-e530b5289a4e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:05.856702 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d725c55a-ef51-46c9-a02d-e530b5289a4e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:05.857358 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d725c55a-ef51-46c9-a02d-e530b5289a4e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:05.982260 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-edf9b0b9-6592-40e8-9a17-779824ea10e3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:05.994167 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-edf9b0b9-6592-40e8-9a17-779824ea10e3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:05.995702 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-edf9b0b9-6592-40e8-9a17-779824ea10e3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:05.998672 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-edf9b0b9-6592-40e8-9a17-779824ea10e3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1745 microversion: 2.20 time: 0.281998 Aug 27 04:35:06.003269 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 272/552] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:35:05 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1745 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:06.073778 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-d725c55a-ef51-46c9-a02d-e530b5289a4e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:06.084089 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-d725c55a-ef51-46c9-a02d-e530b5289a4e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1724 microversion: 2.1 time: 0.242438 Aug 27 04:35:06.085246 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 281/553] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:05 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1724 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:06.654510 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-b7090ab9-67af-47c2-8fc0-7621edfa66ca tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:06.655412 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-b7090ab9-67af-47c2-8fc0-7621edfa66ca tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:06.661998 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b7090ab9-67af-47c2-8fc0-7621edfa66ca tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:06.662450 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b7090ab9-67af-47c2-8fc0-7621edfa66ca tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:06.663273 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b7090ab9-67af-47c2-8fc0-7621edfa66ca tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:06.664077 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b7090ab9-67af-47c2-8fc0-7621edfa66ca tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:06.820069 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-b7090ab9-67af-47c2-8fc0-7621edfa66ca tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:06.829999 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-b7090ab9-67af-47c2-8fc0-7621edfa66ca tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1567 microversion: 2.1 time: 0.179160 Aug 27 04:35:06.840394 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 273/554] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:06 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1567 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:07.017656 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-b6676c9c-dfa5-4e10-bcab-1b978dae789c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:07.018775 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-b6676c9c-dfa5-4e10-bcab-1b978dae789c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:07.025745 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b6676c9c-dfa5-4e10-bcab-1b978dae789c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:07.026276 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b6676c9c-dfa5-4e10-bcab-1b978dae789c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:07.027602 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b6676c9c-dfa5-4e10-bcab-1b978dae789c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:07.028231 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b6676c9c-dfa5-4e10-bcab-1b978dae789c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:07.102309 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-4bf2b9e5-105e-46f0-bf61-c82d5b87ae5d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:07.103138 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-4bf2b9e5-105e-46f0-bf61-c82d5b87ae5d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:07.111373 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4bf2b9e5-105e-46f0-bf61-c82d5b87ae5d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:07.114112 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4bf2b9e5-105e-46f0-bf61-c82d5b87ae5d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:07.115339 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4bf2b9e5-105e-46f0-bf61-c82d5b87ae5d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:07.118038 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4bf2b9e5-105e-46f0-bf61-c82d5b87ae5d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:07.195036 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-b6676c9c-dfa5-4e10-bcab-1b978dae789c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:07.206406 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-b6676c9c-dfa5-4e10-bcab-1b978dae789c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:07.208031 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-b6676c9c-dfa5-4e10-bcab-1b978dae789c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:07.209193 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-b6676c9c-dfa5-4e10-bcab-1b978dae789c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1745 microversion: 2.20 time: 0.195809 Aug 27 04:35:07.210695 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 282/555] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:35:07 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1745 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:07.303701 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-4bf2b9e5-105e-46f0-bf61-c82d5b87ae5d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:07.321628 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-4bf2b9e5-105e-46f0-bf61-c82d5b87ae5d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1724 microversion: 2.1 time: 0.222736 Aug 27 04:35:07.327261 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 274/556] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:07 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1724 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:07.852431 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-3f7aa70f-71dc-4117-8e26-ed6d806299c6 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:07.853499 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-3f7aa70f-71dc-4117-8e26-ed6d806299c6 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:07.864147 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3f7aa70f-71dc-4117-8e26-ed6d806299c6 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:07.864690 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3f7aa70f-71dc-4117-8e26-ed6d806299c6 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:07.865813 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3f7aa70f-71dc-4117-8e26-ed6d806299c6 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:07.866248 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3f7aa70f-71dc-4117-8e26-ed6d806299c6 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:08.040678 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-3f7aa70f-71dc-4117-8e26-ed6d806299c6 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:08.049232 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-3f7aa70f-71dc-4117-8e26-ed6d806299c6 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1567 microversion: 2.1 time: 0.205986 Aug 27 04:35:08.050419 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 283/557] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:07 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1567 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:08.228273 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-62fcd7d4-ea84-4ef0-99e6-96aabe35602a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:08.229532 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-62fcd7d4-ea84-4ef0-99e6-96aabe35602a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:08.235794 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-62fcd7d4-ea84-4ef0-99e6-96aabe35602a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:08.236556 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-62fcd7d4-ea84-4ef0-99e6-96aabe35602a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:08.237400 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-62fcd7d4-ea84-4ef0-99e6-96aabe35602a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:08.237868 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-62fcd7d4-ea84-4ef0-99e6-96aabe35602a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:08.354701 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-95405932-4ca6-4bdd-8900-357ca6a0fe86 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:08.356266 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-95405932-4ca6-4bdd-8900-357ca6a0fe86 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:08.390348 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-62fcd7d4-ea84-4ef0-99e6-96aabe35602a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:08.392004 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-95405932-4ca6-4bdd-8900-357ca6a0fe86 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:08.392554 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-95405932-4ca6-4bdd-8900-357ca6a0fe86 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:08.393692 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-95405932-4ca6-4bdd-8900-357ca6a0fe86 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:08.394136 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-95405932-4ca6-4bdd-8900-357ca6a0fe86 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:08.401707 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-62fcd7d4-ea84-4ef0-99e6-96aabe35602a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:08.403179 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-62fcd7d4-ea84-4ef0-99e6-96aabe35602a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:08.404584 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-62fcd7d4-ea84-4ef0-99e6-96aabe35602a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1745 microversion: 2.20 time: 0.180406 Aug 27 04:35:08.405317 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 275/558] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:35:08 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1745 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:08.553856 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-95405932-4ca6-4bdd-8900-357ca6a0fe86 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:08.561752 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-95405932-4ca6-4bdd-8900-357ca6a0fe86 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1724 microversion: 2.1 time: 0.218112 Aug 27 04:35:08.562323 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 284/559] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:08 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:09.067439 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-53bf7637-74d8-4d15-a6f3-f5be6194bebc tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:09.068094 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-53bf7637-74d8-4d15-a6f3-f5be6194bebc tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:09.074300 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-53bf7637-74d8-4d15-a6f3-f5be6194bebc tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:09.074747 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-53bf7637-74d8-4d15-a6f3-f5be6194bebc tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:09.075544 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-53bf7637-74d8-4d15-a6f3-f5be6194bebc tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:09.075980 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-53bf7637-74d8-4d15-a6f3-f5be6194bebc tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:09.222894 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-53bf7637-74d8-4d15-a6f3-f5be6194bebc tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:09.231352 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-53bf7637-74d8-4d15-a6f3-f5be6194bebc tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1567 microversion: 2.1 time: 0.168296 Aug 27 04:35:09.232287 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 276/560] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:09 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:35:09.422570 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-9de185cf-26d7-4b79-a4e2-094807dde389 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:09.423176 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-9de185cf-26d7-4b79-a4e2-094807dde389 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:09.429758 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9de185cf-26d7-4b79-a4e2-094807dde389 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:09.430196 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9de185cf-26d7-4b79-a4e2-094807dde389 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:09.430954 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9de185cf-26d7-4b79-a4e2-094807dde389 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:09.431384 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9de185cf-26d7-4b79-a4e2-094807dde389 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:09.584638 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-f7e97249-035f-42b5-9d5d-6c02eed46f1c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:09.589520 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-f7e97249-035f-42b5-9d5d-6c02eed46f1c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:09.608698 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f7e97249-035f-42b5-9d5d-6c02eed46f1c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:09.609439 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f7e97249-035f-42b5-9d5d-6c02eed46f1c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:09.610022 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-9de185cf-26d7-4b79-a4e2-094807dde389 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:09.610722 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f7e97249-035f-42b5-9d5d-6c02eed46f1c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:09.611454 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f7e97249-035f-42b5-9d5d-6c02eed46f1c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:09.625444 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-9de185cf-26d7-4b79-a4e2-094807dde389 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:09.626724 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-9de185cf-26d7-4b79-a4e2-094807dde389 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:09.627959 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-9de185cf-26d7-4b79-a4e2-094807dde389 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1745 microversion: 2.20 time: 0.209081 Aug 27 04:35:09.628731 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 285/561] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:35:09 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1745 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:09.728328 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-05865c98-7ffc-45d4-9ac4-1d0519759613 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:09.728854 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-05865c98-7ffc-45d4-9ac4-1d0519759613 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [instance: 89e425c1-0168-4f5d-8635-dd6b9f88c580] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:09.735093 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-05865c98-7ffc-45d4-9ac4-1d0519759613 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:09.735530 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-05865c98-7ffc-45d4-9ac4-1d0519759613 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:09.736336 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-05865c98-7ffc-45d4-9ac4-1d0519759613 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:09.736820 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-05865c98-7ffc-45d4-9ac4-1d0519759613 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:09.753898 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-f7e97249-035f-42b5-9d5d-6c02eed46f1c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:09.767375 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-f7e97249-035f-42b5-9d5d-6c02eed46f1c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1724 microversion: 2.1 time: 0.191471 Aug 27 04:35:09.769352 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 277/562] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:09 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1724 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:09.892963 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-05865c98-7ffc-45d4-9ac4-1d0519759613 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b01f24964a490da63d33097d0f9a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d957eb500948908f38f0f427a9017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:09.914953 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-05865c98-7ffc-45d4-9ac4-1d0519759613 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580" status: 200 len: 1594 microversion: 2.1 time: 0.190002 Aug 27 04:35:09.915968 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 286/563] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:09 2021] GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580 => generated 1594 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:10.253763 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-353d2681-4277-4c1c-9926-2f0c8096becc tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:10.254762 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-353d2681-4277-4c1c-9926-2f0c8096becc tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:10.268111 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-353d2681-4277-4c1c-9926-2f0c8096becc tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:10.270147 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-353d2681-4277-4c1c-9926-2f0c8096becc tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:10.271627 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-353d2681-4277-4c1c-9926-2f0c8096becc tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:10.272831 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-353d2681-4277-4c1c-9926-2f0c8096becc tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:10.647766 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-02d9413d-5343-4e71-8bff-615684c5d007 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:10.649299 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-02d9413d-5343-4e71-8bff-615684c5d007 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:10.661064 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-02d9413d-5343-4e71-8bff-615684c5d007 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:10.662271 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-02d9413d-5343-4e71-8bff-615684c5d007 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:10.663820 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-02d9413d-5343-4e71-8bff-615684c5d007 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:10.664480 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-02d9413d-5343-4e71-8bff-615684c5d007 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:10.757422 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-353d2681-4277-4c1c-9926-2f0c8096becc tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:10.775842 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-353d2681-4277-4c1c-9926-2f0c8096becc tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1567 microversion: 2.1 time: 0.529359 Aug 27 04:35:10.776908 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 278/564] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:10 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1567 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:10.789041 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-2ce1c9cb-458a-4561-825c-17dfcdfb4849 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:10.789806 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-2ce1c9cb-458a-4561-825c-17dfcdfb4849 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:10.807112 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2ce1c9cb-458a-4561-825c-17dfcdfb4849 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:10.808381 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2ce1c9cb-458a-4561-825c-17dfcdfb4849 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:10.809991 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2ce1c9cb-458a-4561-825c-17dfcdfb4849 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:10.811247 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2ce1c9cb-458a-4561-825c-17dfcdfb4849 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:10.898985 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-02d9413d-5343-4e71-8bff-615684c5d007 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:10.912598 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-02d9413d-5343-4e71-8bff-615684c5d007 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:10.920622 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-02d9413d-5343-4e71-8bff-615684c5d007 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:10.923739 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-02d9413d-5343-4e71-8bff-615684c5d007 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1740 microversion: 2.20 time: 0.279830 Aug 27 04:35:10.926133 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 287/565] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:35:10 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1740 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:11.136040 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-2ce1c9cb-458a-4561-825c-17dfcdfb4849 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:11.156937 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-2ce1c9cb-458a-4561-825c-17dfcdfb4849 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1724 microversion: 2.1 time: 0.375427 Aug 27 04:35:11.159353 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 279/566] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:10 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1724 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:35:11.809242 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-d8034dbe-7163-4fe4-a2d7-d9f430ef191e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:11.810149 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-d8034dbe-7163-4fe4-a2d7-d9f430ef191e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:11.825125 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d8034dbe-7163-4fe4-a2d7-d9f430ef191e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:11.845704 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d8034dbe-7163-4fe4-a2d7-d9f430ef191e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:11.847700 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d8034dbe-7163-4fe4-a2d7-d9f430ef191e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:11.861806 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d8034dbe-7163-4fe4-a2d7-d9f430ef191e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:11.947271 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-da02f900-6d4d-452e-ac7d-d3a635332672 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:11.949458 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-da02f900-6d4d-452e-ac7d-d3a635332672 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:11.978802 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-da02f900-6d4d-452e-ac7d-d3a635332672 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:11.980165 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-da02f900-6d4d-452e-ac7d-d3a635332672 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:11.981832 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-da02f900-6d4d-452e-ac7d-d3a635332672 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:11.982795 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-da02f900-6d4d-452e-ac7d-d3a635332672 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:12.237952 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-d8034dbe-7163-4fe4-a2d7-d9f430ef191e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:12.255882 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-d8034dbe-7163-4fe4-a2d7-d9f430ef191e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1567 microversion: 2.1 time: 0.454591 Aug 27 04:35:12.257627 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 288/567] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:11 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1567 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:35:12.271095 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-5e644d81-48a3-46c7-9f24-6820350f948d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:12.272463 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-5e644d81-48a3-46c7-9f24-6820350f948d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:12.280692 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5e644d81-48a3-46c7-9f24-6820350f948d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:12.280692 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5e644d81-48a3-46c7-9f24-6820350f948d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:12.281277 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5e644d81-48a3-46c7-9f24-6820350f948d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:12.281710 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5e644d81-48a3-46c7-9f24-6820350f948d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:12.532900 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-5e644d81-48a3-46c7-9f24-6820350f948d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:12.539584 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-da02f900-6d4d-452e-ac7d-d3a635332672 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:12.555074 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-5e644d81-48a3-46c7-9f24-6820350f948d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1724 microversion: 2.1 time: 0.294856 Aug 27 04:35:12.560020 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-da02f900-6d4d-452e-ac7d-d3a635332672 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:12.563195 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-da02f900-6d4d-452e-ac7d-d3a635332672 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:12.565568 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-da02f900-6d4d-452e-ac7d-d3a635332672 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1740 microversion: 2.20 time: 0.625366 Aug 27 04:35:12.569123 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 289/568] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:12 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1724 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:12.577879 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 280/569] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:35:11 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1740 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:13.096123 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [req-2a21ef61-6698-4814-bb55-81628506f2a4 req-10e30ea4-e7a2-4c71-b6d7-d8fcdfc790c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89e425c1-0168-4f5d-8635-dd6b9f88c580", "tag": "6348fecd-7464-4987-a099-9e9f7e860b0c"}]} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:13.103685 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:35:13.103685 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: warnings.warn(msg) Aug 27 04:35:13.154743 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-2a21ef61-6698-4814-bb55-81628506f2a4 req-10e30ea4-e7a2-4c71-b6d7-d8fcdfc790c0 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:13.156530 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-2a21ef61-6698-4814-bb55-81628506f2a4 req-10e30ea4-e7a2-4c71-b6d7-d8fcdfc790c0 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:13.184686 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.compute.server_external_events [req-2a21ef61-6698-4814-bb55-81628506f2a4 req-10e30ea4-e7a2-4c71-b6d7-d8fcdfc790c0 service nova] Creating event network-changed:6348fecd-7464-4987-a099-9e9f7e860b0c for instance 89e425c1-0168-4f5d-8635-dd6b9f88c580 on hv-cinder-80403 Aug 27 04:35:13.195103 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [req-2a21ef61-6698-4814-bb55-81628506f2a4 req-10e30ea4-e7a2-4c71-b6d7-d8fcdfc790c0 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115262 Aug 27 04:35:13.197111 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 290/570] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:35:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:35:13.276840 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-dd6803b0-5740-4332-b744-e9dbc7e1a10e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:13.277976 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-dd6803b0-5740-4332-b744-e9dbc7e1a10e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:13.295815 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-dd6803b0-5740-4332-b744-e9dbc7e1a10e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:13.296820 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-dd6803b0-5740-4332-b744-e9dbc7e1a10e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:13.297917 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-dd6803b0-5740-4332-b744-e9dbc7e1a10e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:13.300518 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-dd6803b0-5740-4332-b744-e9dbc7e1a10e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:13.587379 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-8ea62c07-7f98-4b09-b6bc-c97a8878d805 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:13.594368 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-8ea62c07-7f98-4b09-b6bc-c97a8878d805 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:13.613711 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8ea62c07-7f98-4b09-b6bc-c97a8878d805 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:13.616947 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8ea62c07-7f98-4b09-b6bc-c97a8878d805 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:13.618757 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8ea62c07-7f98-4b09-b6bc-c97a8878d805 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:13.629134 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8ea62c07-7f98-4b09-b6bc-c97a8878d805 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:13.725452 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-dd6803b0-5740-4332-b744-e9dbc7e1a10e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:13.735592 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-dd6803b0-5740-4332-b744-e9dbc7e1a10e tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1567 microversion: 2.1 time: 0.464771 Aug 27 04:35:13.750056 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 281/571] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:13 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1567 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:13.761912 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-74e90237-1b59-46ee-8b2a-764ea23a18f4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:13.765349 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-74e90237-1b59-46ee-8b2a-764ea23a18f4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:13.783181 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-74e90237-1b59-46ee-8b2a-764ea23a18f4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:13.785880 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-74e90237-1b59-46ee-8b2a-764ea23a18f4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:13.789557 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-74e90237-1b59-46ee-8b2a-764ea23a18f4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:13.792424 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-74e90237-1b59-46ee-8b2a-764ea23a18f4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:14.281415 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-8ea62c07-7f98-4b09-b6bc-c97a8878d805 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:14.289595 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-8ea62c07-7f98-4b09-b6bc-c97a8878d805 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1724 microversion: 2.1 time: 0.710094 Aug 27 04:35:14.308185 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 291/572] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:13 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1724 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:14.426078 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-74e90237-1b59-46ee-8b2a-764ea23a18f4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:14.448208 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-74e90237-1b59-46ee-8b2a-764ea23a18f4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:14.455024 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-74e90237-1b59-46ee-8b2a-764ea23a18f4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:14.462958 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-74e90237-1b59-46ee-8b2a-764ea23a18f4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1740 microversion: 2.20 time: 0.710758 Aug 27 04:35:14.464705 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 282/573] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:35:13 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1740 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:14.760645 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-6184ea1c-1a17-45fb-bd44-49db421d00c3 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:14.761497 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-6184ea1c-1a17-45fb-bd44-49db421d00c3 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:14.777638 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6184ea1c-1a17-45fb-bd44-49db421d00c3 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:14.778243 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6184ea1c-1a17-45fb-bd44-49db421d00c3 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:14.779385 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6184ea1c-1a17-45fb-bd44-49db421d00c3 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:14.782908 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6184ea1c-1a17-45fb-bd44-49db421d00c3 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:15.181436 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-6184ea1c-1a17-45fb-bd44-49db421d00c3 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:15.212220 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-6184ea1c-1a17-45fb-bd44-49db421d00c3 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1567 microversion: 2.1 time: 0.459261 Aug 27 04:35:15.217979 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 292/574] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:14 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1567 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:15.311247 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-900e56db-c6d1-4fa9-b515-5f2809b4ea04 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:15.312244 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-900e56db-c6d1-4fa9-b515-5f2809b4ea04 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:15.319198 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-900e56db-c6d1-4fa9-b515-5f2809b4ea04 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:15.319946 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-900e56db-c6d1-4fa9-b515-5f2809b4ea04 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:15.320980 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-900e56db-c6d1-4fa9-b515-5f2809b4ea04 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:15.321618 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-900e56db-c6d1-4fa9-b515-5f2809b4ea04 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:15.447302 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-5aa985be-303e-4e0a-8de8-f8f910211f16 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1797615336"}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:15.448017 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-5aa985be-303e-4e0a-8de8-f8f910211f16 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [instance: 89e425c1-0168-4f5d-8635-dd6b9f88c580] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:15.457310 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5aa985be-303e-4e0a-8de8-f8f910211f16 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:15.457755 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5aa985be-303e-4e0a-8de8-f8f910211f16 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:15.460133 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5aa985be-303e-4e0a-8de8-f8f910211f16 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:15.460742 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5aa985be-303e-4e0a-8de8-f8f910211f16 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:15.532627 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-900e56db-c6d1-4fa9-b515-5f2809b4ea04 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:15.545268 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-900e56db-c6d1-4fa9-b515-5f2809b4ea04 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1701 microversion: 2.1 time: 0.241540 Aug 27 04:35:15.546012 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 283/575] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:15 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1701 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:15.553041 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-1b67f2b5-1d81-4293-b905-4ce15e76bdc5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:15.553995 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-1b67f2b5-1d81-4293-b905-4ce15e76bdc5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:15.562230 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1b67f2b5-1d81-4293-b905-4ce15e76bdc5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:15.563185 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1b67f2b5-1d81-4293-b905-4ce15e76bdc5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:15.563789 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1b67f2b5-1d81-4293-b905-4ce15e76bdc5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:15.564313 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1b67f2b5-1d81-4293-b905-4ce15e76bdc5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:15.661089 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.network.security_group_api [None req-5aa985be-303e-4e0a-8de8-f8f910211f16 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Adding security group 14b7e024-8502-417f-9c85-de1b593e5325 to port 6348fecd-7464-4987-a099-9e9f7e860b0c Aug 27 04:35:15.735133 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-1b67f2b5-1d81-4293-b905-4ce15e76bdc5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:15.745162 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-1b67f2b5-1d81-4293-b905-4ce15e76bdc5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:15.747100 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-1b67f2b5-1d81-4293-b905-4ce15e76bdc5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:15.748632 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-1b67f2b5-1d81-4293-b905-4ce15e76bdc5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1740 microversion: 2.20 time: 0.201432 Aug 27 04:35:15.761125 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 284/576] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:35:15 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1740 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:15.766506 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-092351c7-facc-4edf-b6ef-d80f8c251bd6 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:15.775475 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-092351c7-facc-4edf-b6ef-d80f8c251bd6 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:15.776290 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-092351c7-facc-4edf-b6ef-d80f8c251bd6 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:15.808817 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-092351c7-facc-4edf-b6ef-d80f8c251bd6 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Going to try to start instance {{(pid=108970) start /opt/stack/nova/nova/compute/api.py:2638}} Aug 27 04:35:15.893947 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-092351c7-facc-4edf-b6ef-d80f8c251bd6 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 202 len: 0 microversion: 2.1 time: 0.128497 Aug 27 04:35:15.895315 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 285/577] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:35:15 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:35:15.904382 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-5a91cfae-f65e-4459-87fa-d7ee73d020c9 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:15.905740 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-5a91cfae-f65e-4459-87fa-d7ee73d020c9 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:15.913982 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5a91cfae-f65e-4459-87fa-d7ee73d020c9 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:15.914711 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5a91cfae-f65e-4459-87fa-d7ee73d020c9 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:15.915714 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5a91cfae-f65e-4459-87fa-d7ee73d020c9 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:15.916346 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5a91cfae-f65e-4459-87fa-d7ee73d020c9 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:16.091200 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-5a91cfae-f65e-4459-87fa-d7ee73d020c9 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:16.102829 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-5a91cfae-f65e-4459-87fa-d7ee73d020c9 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1710 microversion: 2.1 time: 0.202862 Aug 27 04:35:16.106750 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 286/578] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:15 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1710 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:16.237571 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-345a7de4-aece-4b1d-8830-1217e38a53fb tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:16.239032 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-345a7de4-aece-4b1d-8830-1217e38a53fb tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:16.251501 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-345a7de4-aece-4b1d-8830-1217e38a53fb tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:16.253353 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-345a7de4-aece-4b1d-8830-1217e38a53fb tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:16.254518 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-345a7de4-aece-4b1d-8830-1217e38a53fb tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:16.255189 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-345a7de4-aece-4b1d-8830-1217e38a53fb tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:16.357559 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-5aa985be-303e-4e0a-8de8-f8f910211f16 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "POST /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580/action" status: 202 len: 0 microversion: 2.1 time: 0.914346 Aug 27 04:35:16.358370 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 293/579] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:35:15 2021] POST /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580/action => generated 0 bytes in 916 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:35:16.373917 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-bbc921dc-9998-4e0e-b6f1-0dd7e435c022 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:16.374585 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-bbc921dc-9998-4e0e-b6f1-0dd7e435c022 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [instance: 89e425c1-0168-4f5d-8635-dd6b9f88c580] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:16.390906 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-bbc921dc-9998-4e0e-b6f1-0dd7e435c022 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:16.391562 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-bbc921dc-9998-4e0e-b6f1-0dd7e435c022 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:16.392466 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-bbc921dc-9998-4e0e-b6f1-0dd7e435c022 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:16.392964 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-bbc921dc-9998-4e0e-b6f1-0dd7e435c022 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:16.543397 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-345a7de4-aece-4b1d-8830-1217e38a53fb tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:16.557030 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-345a7de4-aece-4b1d-8830-1217e38a53fb tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1567 microversion: 2.1 time: 0.324054 Aug 27 04:35:16.565412 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 287/580] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:16 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1567 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:16.581726 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [req-a46e48ac-4d96-45e6-aa84-712461f22020 req-c0ff9366-4fb9-445a-be38-19ecb3fc1750 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89e425c1-0168-4f5d-8635-dd6b9f88c580", "tag": "6348fecd-7464-4987-a099-9e9f7e860b0c"}]} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:16.583960 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:35:16.583960 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: warnings.warn(msg) Aug 27 04:35:16.596452 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-a46e48ac-4d96-45e6-aa84-712461f22020 req-c0ff9366-4fb9-445a-be38-19ecb3fc1750 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:16.597190 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-a46e48ac-4d96-45e6-aa84-712461f22020 req-c0ff9366-4fb9-445a-be38-19ecb3fc1750 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:16.619352 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.compute.server_external_events [req-a46e48ac-4d96-45e6-aa84-712461f22020 req-c0ff9366-4fb9-445a-be38-19ecb3fc1750 service nova] Creating event network-changed:6348fecd-7464-4987-a099-9e9f7e860b0c for instance 89e425c1-0168-4f5d-8635-dd6b9f88c580 on hv-cinder-80403 Aug 27 04:35:16.635762 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [req-a46e48ac-4d96-45e6-aa84-712461f22020 req-c0ff9366-4fb9-445a-be38-19ecb3fc1750 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068524 Aug 27 04:35:16.636678 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 288/581] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:35:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:35:16.767431 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-04722248-1076-4847-9806-27fb67e013b0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:16.768183 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-04722248-1076-4847-9806-27fb67e013b0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:16.773519 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-bbc921dc-9998-4e0e-b6f1-0dd7e435c022 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b01f24964a490da63d33097d0f9a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d957eb500948908f38f0f427a9017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:16.775411 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-04722248-1076-4847-9806-27fb67e013b0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:16.776550 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-04722248-1076-4847-9806-27fb67e013b0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:16.777524 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-04722248-1076-4847-9806-27fb67e013b0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:16.778330 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-04722248-1076-4847-9806-27fb67e013b0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:16.787516 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-bbc921dc-9998-4e0e-b6f1-0dd7e435c022 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580" status: 200 len: 1759 microversion: 2.1 time: 0.417087 Aug 27 04:35:16.804871 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 294/582] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:16 2021] GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580 => generated 1759 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:17.081741 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-04722248-1076-4847-9806-27fb67e013b0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:17.100292 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-04722248-1076-4847-9806-27fb67e013b0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:17.105441 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-04722248-1076-4847-9806-27fb67e013b0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:17.106990 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-04722248-1076-4847-9806-27fb67e013b0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1740 microversion: 2.20 time: 0.343572 Aug 27 04:35:17.113057 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 289/583] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:35:16 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1740 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:17.124916 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-734a325a-96f1-4a74-820e-a4394b7c5303 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:17.125956 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-734a325a-96f1-4a74-820e-a4394b7c5303 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:17.133604 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-734a325a-96f1-4a74-820e-a4394b7c5303 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:17.134337 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-734a325a-96f1-4a74-820e-a4394b7c5303 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:17.135305 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-734a325a-96f1-4a74-820e-a4394b7c5303 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:17.135900 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-734a325a-96f1-4a74-820e-a4394b7c5303 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:17.431070 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-734a325a-96f1-4a74-820e-a4394b7c5303 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:17.448358 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-734a325a-96f1-4a74-820e-a4394b7c5303 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1710 microversion: 2.1 time: 0.328343 Aug 27 04:35:17.459269 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 295/584] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:17 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1710 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:17.578772 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-9f52c617-bfc1-441b-b8b4-4cf2dfed251c tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:17.580045 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-9f52c617-bfc1-441b-b8b4-4cf2dfed251c tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:17.586517 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9f52c617-bfc1-441b-b8b4-4cf2dfed251c tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:17.587344 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9f52c617-bfc1-441b-b8b4-4cf2dfed251c tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:17.588321 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9f52c617-bfc1-441b-b8b4-4cf2dfed251c tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:17.589356 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9f52c617-bfc1-441b-b8b4-4cf2dfed251c tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:17.842156 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-9f52c617-bfc1-441b-b8b4-4cf2dfed251c tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:17.853925 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-9f52c617-bfc1-441b-b8b4-4cf2dfed251c tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1567 microversion: 2.1 time: 0.279039 Aug 27 04:35:17.864713 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 290/585] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:17 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1567 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:18.132012 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-d68670d9-82ac-4c51-b546-341a25e4337d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:18.133807 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-d68670d9-82ac-4c51-b546-341a25e4337d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:18.142218 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d68670d9-82ac-4c51-b546-341a25e4337d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:18.143489 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d68670d9-82ac-4c51-b546-341a25e4337d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:18.144495 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d68670d9-82ac-4c51-b546-341a25e4337d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:18.144897 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d68670d9-82ac-4c51-b546-341a25e4337d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:18.317847 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-d68670d9-82ac-4c51-b546-341a25e4337d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:18.330078 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-d68670d9-82ac-4c51-b546-341a25e4337d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:18.332494 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-d68670d9-82ac-4c51-b546-341a25e4337d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:18.333977 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-d68670d9-82ac-4c51-b546-341a25e4337d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1740 microversion: 2.20 time: 0.207358 Aug 27 04:35:18.334545 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 296/586] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:35:18 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1740 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:18.466897 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-0a57e258-1f78-4eab-9a1b-87e197e32067 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:18.467511 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-0a57e258-1f78-4eab-9a1b-87e197e32067 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:18.473996 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0a57e258-1f78-4eab-9a1b-87e197e32067 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:18.474386 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0a57e258-1f78-4eab-9a1b-87e197e32067 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:18.475599 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0a57e258-1f78-4eab-9a1b-87e197e32067 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:18.475599 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0a57e258-1f78-4eab-9a1b-87e197e32067 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:18.611763 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-0a57e258-1f78-4eab-9a1b-87e197e32067 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:18.622505 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-0a57e258-1f78-4eab-9a1b-87e197e32067 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1710 microversion: 2.1 time: 0.159575 Aug 27 04:35:18.623696 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 291/587] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:18 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1710 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:18.871658 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-f69439e3-5ca3-4c00-bf7c-187da5079a74 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:18.872388 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-f69439e3-5ca3-4c00-bf7c-187da5079a74 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:18.878555 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f69439e3-5ca3-4c00-bf7c-187da5079a74 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:18.879091 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f69439e3-5ca3-4c00-bf7c-187da5079a74 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:18.879914 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f69439e3-5ca3-4c00-bf7c-187da5079a74 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:18.880432 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f69439e3-5ca3-4c00-bf7c-187da5079a74 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:19.029086 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-f69439e3-5ca3-4c00-bf7c-187da5079a74 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:19.039924 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-f69439e3-5ca3-4c00-bf7c-187da5079a74 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1567 microversion: 2.1 time: 0.170330 Aug 27 04:35:19.048461 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 297/588] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:18 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:19.357881 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-85071b86-c3ce-47e7-a2b1-e0adb72db561 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:19.358515 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-85071b86-c3ce-47e7-a2b1-e0adb72db561 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:19.365666 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-85071b86-c3ce-47e7-a2b1-e0adb72db561 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:19.366371 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-85071b86-c3ce-47e7-a2b1-e0adb72db561 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:19.367955 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-85071b86-c3ce-47e7-a2b1-e0adb72db561 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:19.370110 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-85071b86-c3ce-47e7-a2b1-e0adb72db561 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:19.546331 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-85071b86-c3ce-47e7-a2b1-e0adb72db561 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:19.556109 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-85071b86-c3ce-47e7-a2b1-e0adb72db561 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:19.558154 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-85071b86-c3ce-47e7-a2b1-e0adb72db561 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:19.559310 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-85071b86-c3ce-47e7-a2b1-e0adb72db561 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1740 microversion: 2.20 time: 0.207997 Aug 27 04:35:19.569361 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 292/589] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:35:19 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1740 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:19.647406 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-72a8b2ad-6351-4047-84c1-3fba5388e334 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:19.647956 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-72a8b2ad-6351-4047-84c1-3fba5388e334 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:19.655662 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-72a8b2ad-6351-4047-84c1-3fba5388e334 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:19.656783 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-72a8b2ad-6351-4047-84c1-3fba5388e334 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:19.657867 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-72a8b2ad-6351-4047-84c1-3fba5388e334 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:19.658314 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-72a8b2ad-6351-4047-84c1-3fba5388e334 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:19.813531 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-72a8b2ad-6351-4047-84c1-3fba5388e334 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:19.825807 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-72a8b2ad-6351-4047-84c1-3fba5388e334 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1714 microversion: 2.1 time: 0.188918 Aug 27 04:35:19.826681 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 298/590] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:19 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1714 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:20.060827 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-8e12abf2-ea63-4345-9fb5-01b1d49e24ab tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:20.062192 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-8e12abf2-ea63-4345-9fb5-01b1d49e24ab tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:20.073025 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-8e12abf2-ea63-4345-9fb5-01b1d49e24ab tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:20.073949 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-8e12abf2-ea63-4345-9fb5-01b1d49e24ab tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:20.075424 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-8e12abf2-ea63-4345-9fb5-01b1d49e24ab tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:20.076464 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-8e12abf2-ea63-4345-9fb5-01b1d49e24ab tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:20.230318 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-8e12abf2-ea63-4345-9fb5-01b1d49e24ab tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:20.239092 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-8e12abf2-ea63-4345-9fb5-01b1d49e24ab tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1567 microversion: 2.1 time: 0.185334 Aug 27 04:35:20.240077 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 293/591] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:20 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1567 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:20.578615 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-66f158c2-8d0c-4fb0-82d9-c1b4b667c958 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:20.579219 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-66f158c2-8d0c-4fb0-82d9-c1b4b667c958 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:20.585936 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-66f158c2-8d0c-4fb0-82d9-c1b4b667c958 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:20.586718 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-66f158c2-8d0c-4fb0-82d9-c1b4b667c958 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:20.587494 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-66f158c2-8d0c-4fb0-82d9-c1b4b667c958 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:20.587950 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-66f158c2-8d0c-4fb0-82d9-c1b4b667c958 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:20.740485 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-66f158c2-8d0c-4fb0-82d9-c1b4b667c958 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:20.750402 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-66f158c2-8d0c-4fb0-82d9-c1b4b667c958 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:20.753342 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-66f158c2-8d0c-4fb0-82d9-c1b4b667c958 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:20.754778 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-66f158c2-8d0c-4fb0-82d9-c1b4b667c958 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1740 microversion: 2.20 time: 0.180827 Aug 27 04:35:20.766350 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 299/592] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:35:20 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1740 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:21.257062 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-75b4aa45-a3d1-4408-a0dd-7525ec1375fa tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:21.258554 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-75b4aa45-a3d1-4408-a0dd-7525ec1375fa tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:21.265848 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-75b4aa45-a3d1-4408-a0dd-7525ec1375fa tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:21.266708 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-75b4aa45-a3d1-4408-a0dd-7525ec1375fa tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:21.268669 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-75b4aa45-a3d1-4408-a0dd-7525ec1375fa tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:21.269568 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-75b4aa45-a3d1-4408-a0dd-7525ec1375fa tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:21.414004 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-75b4aa45-a3d1-4408-a0dd-7525ec1375fa tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:21.428424 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-75b4aa45-a3d1-4408-a0dd-7525ec1375fa tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1567 microversion: 2.1 time: 0.174816 Aug 27 04:35:21.429250 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 294/593] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:21 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:21.774854 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-0cdca598-8110-4490-aafd-95e2b807944e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:21.775643 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-0cdca598-8110-4490-aafd-95e2b807944e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:21.783132 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0cdca598-8110-4490-aafd-95e2b807944e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:21.784268 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0cdca598-8110-4490-aafd-95e2b807944e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:21.785127 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0cdca598-8110-4490-aafd-95e2b807944e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:21.785568 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0cdca598-8110-4490-aafd-95e2b807944e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:21.944248 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-0cdca598-8110-4490-aafd-95e2b807944e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:21.954566 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-0cdca598-8110-4490-aafd-95e2b807944e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:21.956719 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-0cdca598-8110-4490-aafd-95e2b807944e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:21.958081 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-0cdca598-8110-4490-aafd-95e2b807944e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1740 microversion: 2.20 time: 0.188028 Aug 27 04:35:21.958831 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 300/594] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:35:21 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:22.450208 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-e6dd4371-31f3-4b48-8f1f-ff4066ed33f2 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:22.453027 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-e6dd4371-31f3-4b48-8f1f-ff4066ed33f2 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:22.460056 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e6dd4371-31f3-4b48-8f1f-ff4066ed33f2 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:22.460507 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e6dd4371-31f3-4b48-8f1f-ff4066ed33f2 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:22.461283 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e6dd4371-31f3-4b48-8f1f-ff4066ed33f2 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:22.461918 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e6dd4371-31f3-4b48-8f1f-ff4066ed33f2 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:22.602126 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-e6dd4371-31f3-4b48-8f1f-ff4066ed33f2 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:22.610756 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-e6dd4371-31f3-4b48-8f1f-ff4066ed33f2 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1567 microversion: 2.1 time: 0.164186 Aug 27 04:35:22.612401 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 295/595] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:22 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:22.976979 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-5d972e85-12ec-42cc-81c1-858b5b324a9b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:22.977543 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-5d972e85-12ec-42cc-81c1-858b5b324a9b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:22.983414 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5d972e85-12ec-42cc-81c1-858b5b324a9b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:22.983844 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5d972e85-12ec-42cc-81c1-858b5b324a9b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:22.984626 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5d972e85-12ec-42cc-81c1-858b5b324a9b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:22.985050 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5d972e85-12ec-42cc-81c1-858b5b324a9b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:23.104700 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-5d972e85-12ec-42cc-81c1-858b5b324a9b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:23.113018 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-5d972e85-12ec-42cc-81c1-858b5b324a9b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:23.114580 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-5d972e85-12ec-42cc-81c1-858b5b324a9b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:23.116002 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-5d972e85-12ec-42cc-81c1-858b5b324a9b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1740 microversion: 2.20 time: 0.142738 Aug 27 04:35:23.116571 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 301/596] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:35:22 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1740 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:23.628577 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-7a088009-7506-4391-af6a-8dd51d3c317b tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:23.629215 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-7a088009-7506-4391-af6a-8dd51d3c317b tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:23.634967 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7a088009-7506-4391-af6a-8dd51d3c317b tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:23.635427 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7a088009-7506-4391-af6a-8dd51d3c317b tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:23.636225 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7a088009-7506-4391-af6a-8dd51d3c317b tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:23.636669 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7a088009-7506-4391-af6a-8dd51d3c317b tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:23.761390 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-7a088009-7506-4391-af6a-8dd51d3c317b tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:23.769580 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-7a088009-7506-4391-af6a-8dd51d3c317b tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1567 microversion: 2.1 time: 0.145288 Aug 27 04:35:23.770153 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 296/597] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:23 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1567 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:24.134320 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-9f1685b6-554b-4ed7-a283-460aa912ee09 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:24.135046 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-9f1685b6-554b-4ed7-a283-460aa912ee09 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:24.141131 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9f1685b6-554b-4ed7-a283-460aa912ee09 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:24.141580 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9f1685b6-554b-4ed7-a283-460aa912ee09 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:24.142346 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9f1685b6-554b-4ed7-a283-460aa912ee09 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:24.143272 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9f1685b6-554b-4ed7-a283-460aa912ee09 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:24.265041 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-9f1685b6-554b-4ed7-a283-460aa912ee09 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:24.273330 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-9f1685b6-554b-4ed7-a283-460aa912ee09 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:24.274825 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-9f1685b6-554b-4ed7-a283-460aa912ee09 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:24.275955 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-9f1685b6-554b-4ed7-a283-460aa912ee09 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1722 microversion: 2.20 time: 0.145364 Aug 27 04:35:24.276535 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 302/598] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:35:24 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1722 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:24.787149 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-cd87d86e-152c-4fe9-a5a6-2f136e1c97d6 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:24.787762 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-cd87d86e-152c-4fe9-a5a6-2f136e1c97d6 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:24.793831 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-cd87d86e-152c-4fe9-a5a6-2f136e1c97d6 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:24.794286 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-cd87d86e-152c-4fe9-a5a6-2f136e1c97d6 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:24.795217 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-cd87d86e-152c-4fe9-a5a6-2f136e1c97d6 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:24.795657 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-cd87d86e-152c-4fe9-a5a6-2f136e1c97d6 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:24.916440 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-cd87d86e-152c-4fe9-a5a6-2f136e1c97d6 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:24.924247 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-cd87d86e-152c-4fe9-a5a6-2f136e1c97d6 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1567 microversion: 2.1 time: 0.141243 Aug 27 04:35:24.924824 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 297/599] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:24 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1567 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:25.295008 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-cb9b214e-3211-42b3-913e-3daabd55ce60 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:25.295612 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-cb9b214e-3211-42b3-913e-3daabd55ce60 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:25.301512 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cb9b214e-3211-42b3-913e-3daabd55ce60 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:25.301948 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cb9b214e-3211-42b3-913e-3daabd55ce60 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:25.302694 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cb9b214e-3211-42b3-913e-3daabd55ce60 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:25.303119 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cb9b214e-3211-42b3-913e-3daabd55ce60 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:25.430241 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-cb9b214e-3211-42b3-913e-3daabd55ce60 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:25.438061 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-cb9b214e-3211-42b3-913e-3daabd55ce60 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:25.440182 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-cb9b214e-3211-42b3-913e-3daabd55ce60 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:25.441331 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-cb9b214e-3211-42b3-913e-3daabd55ce60 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1722 microversion: 2.20 time: 0.150024 Aug 27 04:35:25.441891 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 303/600] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:35:25 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:25.942001 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-f3e57e2b-2922-4357-ad36-e81cecfd3a32 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:25.942606 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-f3e57e2b-2922-4357-ad36-e81cecfd3a32 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:25.948523 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f3e57e2b-2922-4357-ad36-e81cecfd3a32 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:25.948977 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f3e57e2b-2922-4357-ad36-e81cecfd3a32 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:25.949743 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f3e57e2b-2922-4357-ad36-e81cecfd3a32 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:25.950211 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f3e57e2b-2922-4357-ad36-e81cecfd3a32 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:26.072584 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-f3e57e2b-2922-4357-ad36-e81cecfd3a32 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:26.080340 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-f3e57e2b-2922-4357-ad36-e81cecfd3a32 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1567 microversion: 2.1 time: 0.142676 Aug 27 04:35:26.080904 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 298/601] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:25 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1567 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:26.459846 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-3ef6a0f6-5e3c-4e42-8d2a-be8882731188 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:26.460482 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-3ef6a0f6-5e3c-4e42-8d2a-be8882731188 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:26.466378 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3ef6a0f6-5e3c-4e42-8d2a-be8882731188 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:26.466819 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3ef6a0f6-5e3c-4e42-8d2a-be8882731188 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:26.467579 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3ef6a0f6-5e3c-4e42-8d2a-be8882731188 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:26.468043 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3ef6a0f6-5e3c-4e42-8d2a-be8882731188 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:26.598383 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-3ef6a0f6-5e3c-4e42-8d2a-be8882731188 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:26.606206 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-3ef6a0f6-5e3c-4e42-8d2a-be8882731188 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:26.607664 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-3ef6a0f6-5e3c-4e42-8d2a-be8882731188 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:26.608844 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-3ef6a0f6-5e3c-4e42-8d2a-be8882731188 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1722 microversion: 2.20 time: 0.152725 Aug 27 04:35:26.609408 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 304/602] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:35:26 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:27.027692 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [req-4ccf4d61-cdd1-4607-ad2d-66844a0ab038 req-b394b179-2a80-40b6-b028-ae82532969c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3173859-725e-4d66-80af-4223a6643935", "name": "network-vif-unplugged", "status": "completed", "tag": "698af269-46a5-4892-822b-9ef4aa21fa2e"}]} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:27.029679 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:35:27.029679 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: warnings.warn(msg) Aug 27 04:35:27.037005 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-4ccf4d61-cdd1-4607-ad2d-66844a0ab038 req-b394b179-2a80-40b6-b028-ae82532969c9 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:27.037452 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-4ccf4d61-cdd1-4607-ad2d-66844a0ab038 req-b394b179-2a80-40b6-b028-ae82532969c9 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:27.048239 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.compute.server_external_events [req-4ccf4d61-cdd1-4607-ad2d-66844a0ab038 req-b394b179-2a80-40b6-b028-ae82532969c9 service nova] Creating event network-vif-unplugged:698af269-46a5-4892-822b-9ef4aa21fa2e for instance b3173859-725e-4d66-80af-4223a6643935 on hv-cinder-80403 Aug 27 04:35:27.053297 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [req-4ccf4d61-cdd1-4607-ad2d-66844a0ab038 req-b394b179-2a80-40b6-b028-ae82532969c9 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029674 Aug 27 04:35:27.053826 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 299/603] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:35:27 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:35:27.097495 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-7870e203-f538-4fef-85e1-18d03c68296d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:27.098106 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-7870e203-f538-4fef-85e1-18d03c68296d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:27.104151 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7870e203-f538-4fef-85e1-18d03c68296d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:27.104598 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7870e203-f538-4fef-85e1-18d03c68296d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:27.105355 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7870e203-f538-4fef-85e1-18d03c68296d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:27.105907 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7870e203-f538-4fef-85e1-18d03c68296d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:27.225889 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-7870e203-f538-4fef-85e1-18d03c68296d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:27.233648 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-7870e203-f538-4fef-85e1-18d03c68296d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1567 microversion: 2.1 time: 0.139856 Aug 27 04:35:27.234204 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 305/604] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:27 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1567 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:27.627803 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-6872f1ed-59fc-4dc1-9c6f-ceb47a74e663 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:27.628448 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-6872f1ed-59fc-4dc1-9c6f-ceb47a74e663 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:27.634533 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6872f1ed-59fc-4dc1-9c6f-ceb47a74e663 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:27.634987 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6872f1ed-59fc-4dc1-9c6f-ceb47a74e663 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:27.635760 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6872f1ed-59fc-4dc1-9c6f-ceb47a74e663 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:27.636226 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6872f1ed-59fc-4dc1-9c6f-ceb47a74e663 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:27.755408 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-6872f1ed-59fc-4dc1-9c6f-ceb47a74e663 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:27.763382 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-6872f1ed-59fc-4dc1-9c6f-ceb47a74e663 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:27.764928 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-6872f1ed-59fc-4dc1-9c6f-ceb47a74e663 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:27.766069 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-6872f1ed-59fc-4dc1-9c6f-ceb47a74e663 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1722 microversion: 2.20 time: 0.142381 Aug 27 04:35:27.766625 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 300/605] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:35:27 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1722 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:28.251589 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-59351a26-adf1-4394-864b-355e357bae8f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:28.252779 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-59351a26-adf1-4394-864b-355e357bae8f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:28.258482 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-59351a26-adf1-4394-864b-355e357bae8f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:28.258924 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-59351a26-adf1-4394-864b-355e357bae8f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:28.259683 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-59351a26-adf1-4394-864b-355e357bae8f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:28.260147 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-59351a26-adf1-4394-864b-355e357bae8f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:28.387168 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-59351a26-adf1-4394-864b-355e357bae8f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:28.395406 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-59351a26-adf1-4394-864b-355e357bae8f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1567 microversion: 2.1 time: 0.147503 Aug 27 04:35:28.395971 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 306/606] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:28 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:28.783698 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-d3c3334f-908d-4797-a5d2-0c5ecc170178 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:28.784330 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-d3c3334f-908d-4797-a5d2-0c5ecc170178 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:28.790607 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d3c3334f-908d-4797-a5d2-0c5ecc170178 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:28.791044 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d3c3334f-908d-4797-a5d2-0c5ecc170178 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:28.791822 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d3c3334f-908d-4797-a5d2-0c5ecc170178 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:28.792415 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d3c3334f-908d-4797-a5d2-0c5ecc170178 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:28.913127 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-d3c3334f-908d-4797-a5d2-0c5ecc170178 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:28.920838 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-d3c3334f-908d-4797-a5d2-0c5ecc170178 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:28.922327 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-d3c3334f-908d-4797-a5d2-0c5ecc170178 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:28.923463 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-d3c3334f-908d-4797-a5d2-0c5ecc170178 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1725 microversion: 2.20 time: 0.143417 Aug 27 04:35:28.924538 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 301/607] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:35:28 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1725 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:28.943568 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-16b78f96-80e4-4f9a-9aa7-f72f14014f8a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "282cb2bf-86aa-44ab-aa80-8cd0e54ec644"}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:28.944880 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-16b78f96-80e4-4f9a-9aa7-f72f14014f8a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:28.950849 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-16b78f96-80e4-4f9a-9aa7-f72f14014f8a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:28.951377 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-16b78f96-80e4-4f9a-9aa7-f72f14014f8a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:28.952260 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-16b78f96-80e4-4f9a-9aa7-f72f14014f8a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:28.952702 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-16b78f96-80e4-4f9a-9aa7-f72f14014f8a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:29.213663 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-16b78f96-80e4-4f9a-9aa7-f72f14014f8a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.274695 Aug 27 04:35:29.214252 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 307/608] 10.222.0.53 () {62 vars in 1364 bytes} [Fri Aug 27 04:35:28 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/os-volume_attachments => generated 188 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:35:29.333720 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-e0056d93-b542-4d32-b22b-6c66c60b2eec tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:29.334282 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-e0056d93-b542-4d32-b22b-6c66c60b2eec tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:29.340117 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e0056d93-b542-4d32-b22b-6c66c60b2eec tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:29.340568 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e0056d93-b542-4d32-b22b-6c66c60b2eec tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:29.341333 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e0056d93-b542-4d32-b22b-6c66c60b2eec tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:29.341769 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e0056d93-b542-4d32-b22b-6c66c60b2eec tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:29.413051 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-900d410a-16ee-4733-af16-2399a99b6826 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:29.413756 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-900d410a-16ee-4733-af16-2399a99b6826 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:29.418166 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-e0056d93-b542-4d32-b22b-6c66c60b2eec tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action" status: 202 len: 0 microversion: 2.20 time: 0.088104 Aug 27 04:35:29.418972 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 302/609] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:35:29 2021] POST /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:35:29.420524 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-900d410a-16ee-4733-af16-2399a99b6826 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:29.421051 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-900d410a-16ee-4733-af16-2399a99b6826 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:29.422213 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-900d410a-16ee-4733-af16-2399a99b6826 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:29.422729 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-900d410a-16ee-4733-af16-2399a99b6826 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:29.427843 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-f4546e67-404d-4beb-8d9e-4dc9effe2c99 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:29.427843 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-f4546e67-404d-4beb-8d9e-4dc9effe2c99 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:29.433741 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f4546e67-404d-4beb-8d9e-4dc9effe2c99 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:29.434271 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f4546e67-404d-4beb-8d9e-4dc9effe2c99 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:29.435121 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f4546e67-404d-4beb-8d9e-4dc9effe2c99 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:29.435643 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f4546e67-404d-4beb-8d9e-4dc9effe2c99 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:29.563414 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-900d410a-16ee-4733-af16-2399a99b6826 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:29.571461 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-900d410a-16ee-4733-af16-2399a99b6826 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1547 microversion: 2.1 time: 0.161775 Aug 27 04:35:29.571887 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 308/610] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:29 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1547 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:35:29.583135 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-f4546e67-404d-4beb-8d9e-4dc9effe2c99 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:29.590472 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-23db9300-d533-4a45-98a1-bfca11fe7e98 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:29.591480 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-23db9300-d533-4a45-98a1-bfca11fe7e98 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:29.594912 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-f4546e67-404d-4beb-8d9e-4dc9effe2c99 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:29.597751 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-f4546e67-404d-4beb-8d9e-4dc9effe2c99 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:29.599206 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-f4546e67-404d-4beb-8d9e-4dc9effe2c99 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1751 microversion: 2.20 time: 0.176272 Aug 27 04:35:29.604584 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 303/611] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:35:29 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1751 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:35:29.604850 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-23db9300-d533-4a45-98a1-bfca11fe7e98 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:29.604850 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-23db9300-d533-4a45-98a1-bfca11fe7e98 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:29.604850 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-23db9300-d533-4a45-98a1-bfca11fe7e98 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:29.604850 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-23db9300-d533-4a45-98a1-bfca11fe7e98 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:29.733339 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.wsgi [None req-23db9300-d533-4a45-98a1-bfca11fe7e98 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] HTTP exception thrown: Cannot 'detach_volume' instance 0e594817-f3cc-40e6-babe-c736641fb9a9 while it is in vm_state rescued Aug 27 04:35:29.734009 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-23db9300-d533-4a45-98a1-bfca11fe7e98 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Returning 409 to user: Cannot 'detach_volume' instance 0e594817-f3cc-40e6-babe-c736641fb9a9 while it is in vm_state rescued {{(pid=108971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:35:29.734910 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-23db9300-d533-4a45-98a1-bfca11fe7e98 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "DELETE /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9/os-volume_attachments/9328bfc8-6924-4104-a547-533aa4493cae" status: 409 len: 152 microversion: 2.1 time: 0.150350 Aug 27 04:35:29.735555 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 309/612] 10.222.0.53 () {58 vars in 1416 bytes} [Fri Aug 27 04:35:29 2021] DELETE /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9/os-volume_attachments/9328bfc8-6924-4104-a547-533aa4493cae => generated 152 bytes in 152 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:35:29.743967 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-4c10cf48-a0c0-4afe-aac4-4a50fab8a3da tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:29.744534 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-4c10cf48-a0c0-4afe-aac4-4a50fab8a3da tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:29.750182 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4c10cf48-a0c0-4afe-aac4-4a50fab8a3da tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:29.750631 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4c10cf48-a0c0-4afe-aac4-4a50fab8a3da tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:29.751463 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4c10cf48-a0c0-4afe-aac4-4a50fab8a3da tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:29.752561 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4c10cf48-a0c0-4afe-aac4-4a50fab8a3da tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:29.817430 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-4c10cf48-a0c0-4afe-aac4-4a50fab8a3da tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "POST /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9/action" status: 202 len: 0 microversion: 2.1 time: 0.076850 Aug 27 04:35:29.818426 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 304/613] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:35:29 2021] POST /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:35:29.825994 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-8f4088ad-f8c2-408d-9830-de012d0f6947 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:29.826604 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-8f4088ad-f8c2-408d-9830-de012d0f6947 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:29.834260 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8f4088ad-f8c2-408d-9830-de012d0f6947 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:29.834712 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8f4088ad-f8c2-408d-9830-de012d0f6947 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:29.835498 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8f4088ad-f8c2-408d-9830-de012d0f6947 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:29.835932 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8f4088ad-f8c2-408d-9830-de012d0f6947 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:29.979619 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-8f4088ad-f8c2-408d-9830-de012d0f6947 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:29.988953 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-8f4088ad-f8c2-408d-9830-de012d0f6947 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1555 microversion: 2.1 time: 0.166415 Aug 27 04:35:30.000100 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 310/614] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:29 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1555 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:30.619165 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-e75ea4c0-ef68-400b-8872-ea018e4ce91b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:30.619886 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-e75ea4c0-ef68-400b-8872-ea018e4ce91b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:30.625944 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e75ea4c0-ef68-400b-8872-ea018e4ce91b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:30.626406 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e75ea4c0-ef68-400b-8872-ea018e4ce91b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:30.627180 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e75ea4c0-ef68-400b-8872-ea018e4ce91b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:30.627619 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e75ea4c0-ef68-400b-8872-ea018e4ce91b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:30.763731 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-e75ea4c0-ef68-400b-8872-ea018e4ce91b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:30.771824 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-e75ea4c0-ef68-400b-8872-ea018e4ce91b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:30.773353 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-e75ea4c0-ef68-400b-8872-ea018e4ce91b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:30.774485 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-e75ea4c0-ef68-400b-8872-ea018e4ce91b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1753 microversion: 2.20 time: 0.159721 Aug 27 04:35:30.775069 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 305/615] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:35:30 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:31.006404 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-a5d26854-1d91-44d5-8847-8381fe3afdf2 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:31.007017 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-a5d26854-1d91-44d5-8847-8381fe3afdf2 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:31.012805 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a5d26854-1d91-44d5-8847-8381fe3afdf2 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:31.013237 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a5d26854-1d91-44d5-8847-8381fe3afdf2 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:31.014005 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a5d26854-1d91-44d5-8847-8381fe3afdf2 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:31.014498 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a5d26854-1d91-44d5-8847-8381fe3afdf2 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:31.137251 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-a5d26854-1d91-44d5-8847-8381fe3afdf2 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:31.145587 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-a5d26854-1d91-44d5-8847-8381fe3afdf2 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1555 microversion: 2.1 time: 0.142775 Aug 27 04:35:31.146072 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 311/616] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:31 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1555 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:31.793231 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-7c94d570-b1c7-4dd3-9e32-6540b813ed21 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:31.793936 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-7c94d570-b1c7-4dd3-9e32-6540b813ed21 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:31.800427 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7c94d570-b1c7-4dd3-9e32-6540b813ed21 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:31.800879 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7c94d570-b1c7-4dd3-9e32-6540b813ed21 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:31.801647 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7c94d570-b1c7-4dd3-9e32-6540b813ed21 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:31.802080 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7c94d570-b1c7-4dd3-9e32-6540b813ed21 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:31.925713 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-7c94d570-b1c7-4dd3-9e32-6540b813ed21 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:31.934016 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-7c94d570-b1c7-4dd3-9e32-6540b813ed21 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:31.935524 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-7c94d570-b1c7-4dd3-9e32-6540b813ed21 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:31.936689 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-7c94d570-b1c7-4dd3-9e32-6540b813ed21 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1809 microversion: 2.20 time: 0.147205 Aug 27 04:35:31.937250 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 306/617] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:35:31 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1809 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:32.167331 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-215064ce-b497-4af3-b1c4-41b8ed6e78c1 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:32.167926 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-215064ce-b497-4af3-b1c4-41b8ed6e78c1 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:32.175083 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-215064ce-b497-4af3-b1c4-41b8ed6e78c1 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:32.175533 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-215064ce-b497-4af3-b1c4-41b8ed6e78c1 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:32.176340 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-215064ce-b497-4af3-b1c4-41b8ed6e78c1 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:32.176778 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-215064ce-b497-4af3-b1c4-41b8ed6e78c1 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:32.300423 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-215064ce-b497-4af3-b1c4-41b8ed6e78c1 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:32.308156 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-215064ce-b497-4af3-b1c4-41b8ed6e78c1 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1555 microversion: 2.1 time: 0.144483 Aug 27 04:35:32.308725 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 312/618] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:32 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1555 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:32.955780 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-7e9b9e68-8cba-40cf-a0f7-a3f27c3a2fc7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:32.956416 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-7e9b9e68-8cba-40cf-a0f7-a3f27c3a2fc7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:32.962194 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7e9b9e68-8cba-40cf-a0f7-a3f27c3a2fc7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:32.962644 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7e9b9e68-8cba-40cf-a0f7-a3f27c3a2fc7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:32.963417 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7e9b9e68-8cba-40cf-a0f7-a3f27c3a2fc7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:32.963856 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7e9b9e68-8cba-40cf-a0f7-a3f27c3a2fc7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:33.141031 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-7e9b9e68-8cba-40cf-a0f7-a3f27c3a2fc7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:33.149668 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-7e9b9e68-8cba-40cf-a0f7-a3f27c3a2fc7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:33.151212 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-7e9b9e68-8cba-40cf-a0f7-a3f27c3a2fc7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:33.152492 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-7e9b9e68-8cba-40cf-a0f7-a3f27c3a2fc7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1809 microversion: 2.20 time: 0.200352 Aug 27 04:35:33.152939 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 307/619] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:35:32 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1809 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:33.325150 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-b3144f3d-ecbf-4645-bb09-3543788b8cf8 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:33.325782 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-b3144f3d-ecbf-4645-bb09-3543788b8cf8 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:33.334640 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b3144f3d-ecbf-4645-bb09-3543788b8cf8 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:33.335022 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b3144f3d-ecbf-4645-bb09-3543788b8cf8 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:33.335787 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b3144f3d-ecbf-4645-bb09-3543788b8cf8 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:33.336258 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b3144f3d-ecbf-4645-bb09-3543788b8cf8 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:33.462059 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-b3144f3d-ecbf-4645-bb09-3543788b8cf8 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:33.470059 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-b3144f3d-ecbf-4645-bb09-3543788b8cf8 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1555 microversion: 2.1 time: 0.148480 Aug 27 04:35:33.471282 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 313/620] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:33 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1555 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:34.170570 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-e4fa7098-84c0-4862-918f-7dd92dd237e6 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:34.172225 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-e4fa7098-84c0-4862-918f-7dd92dd237e6 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:34.179016 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e4fa7098-84c0-4862-918f-7dd92dd237e6 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:34.179467 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e4fa7098-84c0-4862-918f-7dd92dd237e6 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:34.180431 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e4fa7098-84c0-4862-918f-7dd92dd237e6 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:34.180870 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e4fa7098-84c0-4862-918f-7dd92dd237e6 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:34.304813 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-e4fa7098-84c0-4862-918f-7dd92dd237e6 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:34.313471 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-e4fa7098-84c0-4862-918f-7dd92dd237e6 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:34.315025 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-e4fa7098-84c0-4862-918f-7dd92dd237e6 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:34.316208 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-e4fa7098-84c0-4862-918f-7dd92dd237e6 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1809 microversion: 2.20 time: 0.149450 Aug 27 04:35:34.316776 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 308/621] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:35:34 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:35:34.487905 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-9ac00753-96de-4a9d-bb29-c468b4d2e035 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:34.488493 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-9ac00753-96de-4a9d-bb29-c468b4d2e035 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:34.494551 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9ac00753-96de-4a9d-bb29-c468b4d2e035 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:34.494989 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9ac00753-96de-4a9d-bb29-c468b4d2e035 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:34.495744 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9ac00753-96de-4a9d-bb29-c468b4d2e035 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:34.496203 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9ac00753-96de-4a9d-bb29-c468b4d2e035 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:34.623733 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-9ac00753-96de-4a9d-bb29-c468b4d2e035 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:34.631813 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-9ac00753-96de-4a9d-bb29-c468b4d2e035 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1555 microversion: 2.1 time: 0.148159 Aug 27 04:35:34.632408 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 314/622] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:34 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1555 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:35.334497 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-9ab3f4a6-da66-4e7c-853c-4872063c783b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:35.335121 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-9ab3f4a6-da66-4e7c-853c-4872063c783b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:35.341600 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9ab3f4a6-da66-4e7c-853c-4872063c783b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:35.342052 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9ab3f4a6-da66-4e7c-853c-4872063c783b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:35.342851 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9ab3f4a6-da66-4e7c-853c-4872063c783b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:35.343291 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9ab3f4a6-da66-4e7c-853c-4872063c783b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:35.482380 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-9ab3f4a6-da66-4e7c-853c-4872063c783b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:35.492363 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-9ab3f4a6-da66-4e7c-853c-4872063c783b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:35.494290 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-9ab3f4a6-da66-4e7c-853c-4872063c783b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:35.495491 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-9ab3f4a6-da66-4e7c-853c-4872063c783b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1809 microversion: 2.20 time: 0.164787 Aug 27 04:35:35.496129 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 309/623] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:35:35 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:35.648633 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-43c072a5-f0ea-482b-b14f-42c314bfd14f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:35.649244 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-43c072a5-f0ea-482b-b14f-42c314bfd14f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:35.655039 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-43c072a5-f0ea-482b-b14f-42c314bfd14f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:35.655484 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-43c072a5-f0ea-482b-b14f-42c314bfd14f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:35.656275 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-43c072a5-f0ea-482b-b14f-42c314bfd14f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:35.656716 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-43c072a5-f0ea-482b-b14f-42c314bfd14f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:35.785395 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-43c072a5-f0ea-482b-b14f-42c314bfd14f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:35.793405 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-43c072a5-f0ea-482b-b14f-42c314bfd14f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1555 microversion: 2.1 time: 0.148397 Aug 27 04:35:35.793984 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 315/624] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:35 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1555 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:36.514525 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-0aff05a4-a23a-40c3-8575-2fd6816bd8b1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:36.515173 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-0aff05a4-a23a-40c3-8575-2fd6816bd8b1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:36.521834 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0aff05a4-a23a-40c3-8575-2fd6816bd8b1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:36.522277 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0aff05a4-a23a-40c3-8575-2fd6816bd8b1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:36.523043 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0aff05a4-a23a-40c3-8575-2fd6816bd8b1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:36.523479 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0aff05a4-a23a-40c3-8575-2fd6816bd8b1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:36.650928 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-0aff05a4-a23a-40c3-8575-2fd6816bd8b1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:36.659626 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-0aff05a4-a23a-40c3-8575-2fd6816bd8b1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:36.661178 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-0aff05a4-a23a-40c3-8575-2fd6816bd8b1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:36.662333 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-0aff05a4-a23a-40c3-8575-2fd6816bd8b1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1809 microversion: 2.20 time: 0.151569 Aug 27 04:35:36.662898 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 310/625] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:35:36 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:36.810850 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-fa36d33b-1d9a-4776-b4ce-2861a2c6b682 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:36.811444 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-fa36d33b-1d9a-4776-b4ce-2861a2c6b682 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:36.817927 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-fa36d33b-1d9a-4776-b4ce-2861a2c6b682 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:36.818375 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-fa36d33b-1d9a-4776-b4ce-2861a2c6b682 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:36.819145 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-fa36d33b-1d9a-4776-b4ce-2861a2c6b682 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:36.819585 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-fa36d33b-1d9a-4776-b4ce-2861a2c6b682 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:36.945939 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-fa36d33b-1d9a-4776-b4ce-2861a2c6b682 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:36.954525 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-fa36d33b-1d9a-4776-b4ce-2861a2c6b682 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1555 microversion: 2.1 time: 0.147579 Aug 27 04:35:36.955119 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 316/626] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:36 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1555 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:37.681005 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-6ff79f96-b2e2-436e-8704-e6d591419939 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:37.681604 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-6ff79f96-b2e2-436e-8704-e6d591419939 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:37.687373 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6ff79f96-b2e2-436e-8704-e6d591419939 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:37.687829 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6ff79f96-b2e2-436e-8704-e6d591419939 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:37.688711 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6ff79f96-b2e2-436e-8704-e6d591419939 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:37.689155 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6ff79f96-b2e2-436e-8704-e6d591419939 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:37.811014 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-6ff79f96-b2e2-436e-8704-e6d591419939 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:37.819934 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-6ff79f96-b2e2-436e-8704-e6d591419939 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:37.821505 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-6ff79f96-b2e2-436e-8704-e6d591419939 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:37.822648 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-6ff79f96-b2e2-436e-8704-e6d591419939 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1809 microversion: 2.20 time: 0.145490 Aug 27 04:35:37.823210 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 311/627] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:35:37 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1809 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:37.972435 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-a892e5c0-e10d-49fa-820c-ecbba0c46eda tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:37.973011 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-a892e5c0-e10d-49fa-820c-ecbba0c46eda tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:37.978844 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a892e5c0-e10d-49fa-820c-ecbba0c46eda tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:37.979285 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a892e5c0-e10d-49fa-820c-ecbba0c46eda tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:37.980064 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a892e5c0-e10d-49fa-820c-ecbba0c46eda tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:37.980498 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a892e5c0-e10d-49fa-820c-ecbba0c46eda tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:38.104913 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-a892e5c0-e10d-49fa-820c-ecbba0c46eda tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:38.112737 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-a892e5c0-e10d-49fa-820c-ecbba0c46eda tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1555 microversion: 2.1 time: 0.144613 Aug 27 04:35:38.113213 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 317/628] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:37 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1555 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:38.841612 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-33e19f39-dd0a-4a6f-a723-871e02e3d27d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:38.842346 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-33e19f39-dd0a-4a6f-a723-871e02e3d27d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:38.848657 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-33e19f39-dd0a-4a6f-a723-871e02e3d27d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:38.849335 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-33e19f39-dd0a-4a6f-a723-871e02e3d27d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:38.850110 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-33e19f39-dd0a-4a6f-a723-871e02e3d27d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:38.850544 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-33e19f39-dd0a-4a6f-a723-871e02e3d27d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:38.970744 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-33e19f39-dd0a-4a6f-a723-871e02e3d27d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:38.978873 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-33e19f39-dd0a-4a6f-a723-871e02e3d27d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:38.980390 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-33e19f39-dd0a-4a6f-a723-871e02e3d27d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:38.981510 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-33e19f39-dd0a-4a6f-a723-871e02e3d27d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1809 microversion: 2.20 time: 0.143616 Aug 27 04:35:38.982067 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 312/629] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:35:38 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1809 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:35:39.130584 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-be0adec7-f0fd-4be8-996b-a9b20a74110a tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:39.131176 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-be0adec7-f0fd-4be8-996b-a9b20a74110a tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:39.137062 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-be0adec7-f0fd-4be8-996b-a9b20a74110a tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:39.137511 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-be0adec7-f0fd-4be8-996b-a9b20a74110a tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:39.138275 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-be0adec7-f0fd-4be8-996b-a9b20a74110a tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:39.138738 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-be0adec7-f0fd-4be8-996b-a9b20a74110a tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:39.259050 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-be0adec7-f0fd-4be8-996b-a9b20a74110a tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:39.267598 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-be0adec7-f0fd-4be8-996b-a9b20a74110a tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1555 microversion: 2.1 time: 0.140299 Aug 27 04:35:39.268249 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 318/630] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:39 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1555 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:40.000135 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-dab5b941-9331-4c54-93aa-d3966929eef9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:40.000794 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-dab5b941-9331-4c54-93aa-d3966929eef9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:40.007275 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-dab5b941-9331-4c54-93aa-d3966929eef9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:40.007724 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-dab5b941-9331-4c54-93aa-d3966929eef9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:40.008527 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-dab5b941-9331-4c54-93aa-d3966929eef9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:40.008962 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-dab5b941-9331-4c54-93aa-d3966929eef9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:40.139086 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-dab5b941-9331-4c54-93aa-d3966929eef9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:40.149064 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-dab5b941-9331-4c54-93aa-d3966929eef9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:40.150586 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-dab5b941-9331-4c54-93aa-d3966929eef9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:40.151741 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-dab5b941-9331-4c54-93aa-d3966929eef9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1809 microversion: 2.20 time: 0.155352 Aug 27 04:35:40.152334 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 313/631] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:35:39 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:40.284337 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-d1eb19a7-327b-49de-9286-b298dd1f78b6 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:40.284949 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-d1eb19a7-327b-49de-9286-b298dd1f78b6 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:40.291196 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d1eb19a7-327b-49de-9286-b298dd1f78b6 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:40.291723 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d1eb19a7-327b-49de-9286-b298dd1f78b6 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:40.292608 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d1eb19a7-327b-49de-9286-b298dd1f78b6 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:40.293236 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d1eb19a7-327b-49de-9286-b298dd1f78b6 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:40.415929 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-d1eb19a7-327b-49de-9286-b298dd1f78b6 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:40.423720 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-d1eb19a7-327b-49de-9286-b298dd1f78b6 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1555 microversion: 2.1 time: 0.143122 Aug 27 04:35:40.424313 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 319/632] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:40 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1555 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:40.503210 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-5cf27ef1-f83d-48a8-8e04-454bc0cf9836 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-271313980", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-305484201", "security_groups": [{"name": "tempest-secgroup-smoke-1629615019"}], "networks": [{"uuid": "b21e6d58-b603-4de5-b590-c7fcfbf8b75a"}], "block_device_mapping_v2": [{"uuid": "cc821485-2bc4-4b10-b087-8937c939faec", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:40.606901 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.network.neutron [None req-5cf27ef1-f83d-48a8-8e04-454bc0cf9836 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] validate_networks() for [('b21e6d58-b603-4de5-b590-c7fcfbf8b75a', None, None, None, None, None)] {{(pid=108970) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 04:35:40.978741 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.virt.hardware [None req-5cf27ef1-f83d-48a8-8e04-454bc0cf9836 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Flavor limits 0:0:0 {{(pid=108970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:35:40.979296 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.virt.hardware [None req-5cf27ef1-f83d-48a8-8e04-454bc0cf9836 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Image limits 0:0:0 {{(pid=108970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:35:40.979921 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.virt.hardware [None req-5cf27ef1-f83d-48a8-8e04-454bc0cf9836 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Flavor pref 0:0:0 {{(pid=108970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:35:40.980367 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.virt.hardware [None req-5cf27ef1-f83d-48a8-8e04-454bc0cf9836 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Image pref 0:0:0 {{(pid=108970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:35:40.980781 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.virt.hardware [None req-5cf27ef1-f83d-48a8-8e04-454bc0cf9836 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:35:40.991284 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5cf27ef1-f83d-48a8-8e04-454bc0cf9836 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:40.991737 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5cf27ef1-f83d-48a8-8e04-454bc0cf9836 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:40.992576 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5cf27ef1-f83d-48a8-8e04-454bc0cf9836 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:40.993013 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5cf27ef1-f83d-48a8-8e04-454bc0cf9836 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:41.009753 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.quota [None req-5cf27ef1-f83d-48a8-8e04-454bc0cf9836 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Getting quotas for project a4c45e6a7cab4d2db5a499b8f2323e6a. Resources: {'ram', 'cores', 'instances'} {{(pid=108970) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:35:41.013878 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.quota [None req-5cf27ef1-f83d-48a8-8e04-454bc0cf9836 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Getting quotas for user 74221dde8a0048af90dd03d8132aa68f and project a4c45e6a7cab4d2db5a499b8f2323e6a. Resources: {'ram', 'cores', 'instances'} {{(pid=108970) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:35:41.076690 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-5cf27ef1-f83d-48a8-8e04-454bc0cf9836 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Going to run 1 instances... {{(pid=108970) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 04:35:41.078947 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-5cf27ef1-f83d-48a8-8e04-454bc0cf9836 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cc821485-2bc4-4b10-b087-8937c939faec',volume_size=None,volume_type=None)] {{(pid=108970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 04:35:41.178592 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-188640c2-e1f7-4652-81ab-c8b257dbf4f7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:41.179320 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-188640c2-e1f7-4652-81ab-c8b257dbf4f7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:41.191978 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-188640c2-e1f7-4652-81ab-c8b257dbf4f7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:41.192456 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-188640c2-e1f7-4652-81ab-c8b257dbf4f7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:41.193280 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-188640c2-e1f7-4652-81ab-c8b257dbf4f7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:41.193718 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-188640c2-e1f7-4652-81ab-c8b257dbf4f7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:41.240591 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-5cf27ef1-f83d-48a8-8e04-454bc0cf9836 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.741987 Aug 27 04:35:41.241344 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 314/633] 10.222.0.53 () {60 vars in 1147 bytes} [Fri Aug 27 04:35:40 2021] POST /compute/v2.1/servers => generated 406 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:35:41.251616 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-76a0d7aa-04ad-42e0-95d8-25d643b96b64 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:41.252276 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-76a0d7aa-04ad-42e0-95d8-25d643b96b64 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:41.333581 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-76a0d7aa-04ad-42e0-95d8-25d643b96b64 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:41.347102 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-76a0d7aa-04ad-42e0-95d8-25d643b96b64 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1087 microversion: 2.1 time: 0.099168 Aug 27 04:35:41.348093 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 315/634] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:41 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1087 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:35:41.359169 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-188640c2-e1f7-4652-81ab-c8b257dbf4f7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:41.370201 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-188640c2-e1f7-4652-81ab-c8b257dbf4f7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:41.371743 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-188640c2-e1f7-4652-81ab-c8b257dbf4f7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:41.372939 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-188640c2-e1f7-4652-81ab-c8b257dbf4f7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1809 microversion: 2.20 time: 0.204866 Aug 27 04:35:41.380444 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 320/635] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:35:41 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1809 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:41.440907 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-9216ea17-7312-4781-93db-e767a2790f43 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:41.441648 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-9216ea17-7312-4781-93db-e767a2790f43 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:41.454346 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9216ea17-7312-4781-93db-e767a2790f43 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:41.454950 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9216ea17-7312-4781-93db-e767a2790f43 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:41.455751 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9216ea17-7312-4781-93db-e767a2790f43 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:41.456219 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9216ea17-7312-4781-93db-e767a2790f43 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:41.608120 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-9216ea17-7312-4781-93db-e767a2790f43 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:41.616665 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-9216ea17-7312-4781-93db-e767a2790f43 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1555 microversion: 2.1 time: 0.180223 Aug 27 04:35:41.617465 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 316/636] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:41 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1555 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:42.367061 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-1935e49c-0709-4b8b-ab5f-bdefe0bfcb5d tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:42.367735 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-1935e49c-0709-4b8b-ab5f-bdefe0bfcb5d tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:42.373839 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1935e49c-0709-4b8b-ab5f-bdefe0bfcb5d tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:42.374357 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1935e49c-0709-4b8b-ab5f-bdefe0bfcb5d tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:42.375192 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1935e49c-0709-4b8b-ab5f-bdefe0bfcb5d tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:42.375687 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1935e49c-0709-4b8b-ab5f-bdefe0bfcb5d tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:42.397201 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-b4c27628-2447-401f-a9fe-34ea03892a41 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:42.398525 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-b4c27628-2447-401f-a9fe-34ea03892a41 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:42.404342 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b4c27628-2447-401f-a9fe-34ea03892a41 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:42.404876 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b4c27628-2447-401f-a9fe-34ea03892a41 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:42.405771 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b4c27628-2447-401f-a9fe-34ea03892a41 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:42.406291 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b4c27628-2447-401f-a9fe-34ea03892a41 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:42.435322 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-1935e49c-0709-4b8b-ab5f-bdefe0bfcb5d tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:42.443484 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-1935e49c-0709-4b8b-ab5f-bdefe0bfcb5d tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1137 microversion: 2.1 time: 0.080411 Aug 27 04:35:42.452456 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 321/637] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:42 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1137 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:42.536810 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-b4c27628-2447-401f-a9fe-34ea03892a41 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:42.546262 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-b4c27628-2447-401f-a9fe-34ea03892a41 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:42.547775 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-b4c27628-2447-401f-a9fe-34ea03892a41 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:42.549600 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-b4c27628-2447-401f-a9fe-34ea03892a41 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1809 microversion: 2.20 time: 0.156165 Aug 27 04:35:42.550295 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 317/638] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:35:42 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:35:42.633817 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-46333e49-8ae9-43a8-a068-c24be470ee74 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:42.634337 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-46333e49-8ae9-43a8-a068-c24be470ee74 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:42.640411 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-46333e49-8ae9-43a8-a068-c24be470ee74 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:42.641049 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-46333e49-8ae9-43a8-a068-c24be470ee74 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:42.641696 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-46333e49-8ae9-43a8-a068-c24be470ee74 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:42.642950 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-46333e49-8ae9-43a8-a068-c24be470ee74 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:42.766895 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-46333e49-8ae9-43a8-a068-c24be470ee74 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:42.774833 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-46333e49-8ae9-43a8-a068-c24be470ee74 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1555 microversion: 2.1 time: 0.144693 Aug 27 04:35:42.775593 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 322/639] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:42 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1555 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:43.459716 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-17de5f63-9262-44d5-a643-d7ef80b6f67e tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:43.460372 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-17de5f63-9262-44d5-a643-d7ef80b6f67e tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:43.466399 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-17de5f63-9262-44d5-a643-d7ef80b6f67e tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:43.466856 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-17de5f63-9262-44d5-a643-d7ef80b6f67e tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:43.467630 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-17de5f63-9262-44d5-a643-d7ef80b6f67e tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:43.468135 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-17de5f63-9262-44d5-a643-d7ef80b6f67e tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:43.528314 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-17de5f63-9262-44d5-a643-d7ef80b6f67e tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:43.536354 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-17de5f63-9262-44d5-a643-d7ef80b6f67e tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1137 microversion: 2.1 time: 0.080234 Aug 27 04:35:43.537702 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 318/640] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:43 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1137 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:43.568068 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-92bb9dbc-e8d5-4326-a993-5703d6054fd5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:43.568668 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-92bb9dbc-e8d5-4326-a993-5703d6054fd5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:43.574781 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-92bb9dbc-e8d5-4326-a993-5703d6054fd5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:43.575216 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-92bb9dbc-e8d5-4326-a993-5703d6054fd5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:43.575979 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-92bb9dbc-e8d5-4326-a993-5703d6054fd5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:43.576428 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-92bb9dbc-e8d5-4326-a993-5703d6054fd5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:43.700196 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-92bb9dbc-e8d5-4326-a993-5703d6054fd5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:43.709309 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-92bb9dbc-e8d5-4326-a993-5703d6054fd5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:43.710808 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-92bb9dbc-e8d5-4326-a993-5703d6054fd5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:43.711966 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-92bb9dbc-e8d5-4326-a993-5703d6054fd5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1809 microversion: 2.20 time: 0.147687 Aug 27 04:35:43.714901 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 323/641] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:35:43 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1809 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:43.792662 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-55f31e2b-dca7-4eb5-a2f7-07b9ff2d74fe tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:43.793366 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-55f31e2b-dca7-4eb5-a2f7-07b9ff2d74fe tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:43.799692 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-55f31e2b-dca7-4eb5-a2f7-07b9ff2d74fe tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:43.800277 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-55f31e2b-dca7-4eb5-a2f7-07b9ff2d74fe tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:43.801130 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-55f31e2b-dca7-4eb5-a2f7-07b9ff2d74fe tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:43.801686 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-55f31e2b-dca7-4eb5-a2f7-07b9ff2d74fe tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:43.923749 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-55f31e2b-dca7-4eb5-a2f7-07b9ff2d74fe tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:43.931851 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-55f31e2b-dca7-4eb5-a2f7-07b9ff2d74fe tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1555 microversion: 2.1 time: 0.143047 Aug 27 04:35:43.932483 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 319/642] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:43 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1555 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:44.553808 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-eaae0ff6-c064-492f-80ca-315019dbfb88 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:44.554415 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-eaae0ff6-c064-492f-80ca-315019dbfb88 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:44.560662 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-eaae0ff6-c064-492f-80ca-315019dbfb88 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:44.561093 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-eaae0ff6-c064-492f-80ca-315019dbfb88 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:44.561861 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-eaae0ff6-c064-492f-80ca-315019dbfb88 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:44.562289 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-eaae0ff6-c064-492f-80ca-315019dbfb88 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:44.625779 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-eaae0ff6-c064-492f-80ca-315019dbfb88 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:44.634338 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-eaae0ff6-c064-492f-80ca-315019dbfb88 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1137 microversion: 2.1 time: 0.084443 Aug 27 04:35:44.634910 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 324/643] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:44 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1137 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:35:44.730489 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-ab7cf34f-c86d-4ffb-b103-08516074fefb tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:44.731159 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-ab7cf34f-c86d-4ffb-b103-08516074fefb tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:44.738047 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ab7cf34f-c86d-4ffb-b103-08516074fefb tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:44.738499 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ab7cf34f-c86d-4ffb-b103-08516074fefb tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:44.739669 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ab7cf34f-c86d-4ffb-b103-08516074fefb tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:44.740169 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ab7cf34f-c86d-4ffb-b103-08516074fefb tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:44.863372 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-ab7cf34f-c86d-4ffb-b103-08516074fefb tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:44.872328 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-ab7cf34f-c86d-4ffb-b103-08516074fefb tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:44.873872 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-ab7cf34f-c86d-4ffb-b103-08516074fefb tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:44.874948 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-ab7cf34f-c86d-4ffb-b103-08516074fefb tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1809 microversion: 2.20 time: 0.148263 Aug 27 04:35:44.875687 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 320/644] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:35:44 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1809 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:44.948851 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-04f8fcfa-4398-4c92-b885-006b1f577be9 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:44.949459 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-04f8fcfa-4398-4c92-b885-006b1f577be9 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:44.955757 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-04f8fcfa-4398-4c92-b885-006b1f577be9 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:44.956259 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-04f8fcfa-4398-4c92-b885-006b1f577be9 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:44.957106 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-04f8fcfa-4398-4c92-b885-006b1f577be9 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:44.957544 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-04f8fcfa-4398-4c92-b885-006b1f577be9 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:45.080459 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-04f8fcfa-4398-4c92-b885-006b1f577be9 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:45.088778 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-04f8fcfa-4398-4c92-b885-006b1f577be9 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1555 microversion: 2.1 time: 0.143511 Aug 27 04:35:45.089356 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 325/645] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:44 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1555 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:45.650640 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-997510f8-2930-434c-9871-795311b3e998 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:45.651275 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-997510f8-2930-434c-9871-795311b3e998 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:45.657338 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-997510f8-2930-434c-9871-795311b3e998 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:45.657790 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-997510f8-2930-434c-9871-795311b3e998 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:45.658562 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-997510f8-2930-434c-9871-795311b3e998 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:45.658997 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-997510f8-2930-434c-9871-795311b3e998 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:45.725813 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-997510f8-2930-434c-9871-795311b3e998 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:45.735582 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-997510f8-2930-434c-9871-795311b3e998 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1137 microversion: 2.1 time: 0.088843 Aug 27 04:35:45.736589 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 321/646] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:45 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1137 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:45.892858 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-6a19f1c5-5b4b-410b-911e-46393fce5439 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:45.893464 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-6a19f1c5-5b4b-410b-911e-46393fce5439 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:45.899243 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6a19f1c5-5b4b-410b-911e-46393fce5439 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:45.899681 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6a19f1c5-5b4b-410b-911e-46393fce5439 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:45.900462 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6a19f1c5-5b4b-410b-911e-46393fce5439 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:45.900938 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6a19f1c5-5b4b-410b-911e-46393fce5439 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:46.023535 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-6a19f1c5-5b4b-410b-911e-46393fce5439 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:46.031791 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-6a19f1c5-5b4b-410b-911e-46393fce5439 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:46.033305 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-6a19f1c5-5b4b-410b-911e-46393fce5439 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:46.034438 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-6a19f1c5-5b4b-410b-911e-46393fce5439 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1809 microversion: 2.20 time: 0.145275 Aug 27 04:35:46.034992 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 326/647] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:35:45 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1809 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:35:46.106251 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-24b42565-1526-4693-965f-f42c89f366f7 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:46.106864 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-24b42565-1526-4693-965f-f42c89f366f7 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:46.113340 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-24b42565-1526-4693-965f-f42c89f366f7 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:46.113790 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-24b42565-1526-4693-965f-f42c89f366f7 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:46.114845 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-24b42565-1526-4693-965f-f42c89f366f7 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:46.115285 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-24b42565-1526-4693-965f-f42c89f366f7 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:46.237154 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-24b42565-1526-4693-965f-f42c89f366f7 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:46.245679 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-24b42565-1526-4693-965f-f42c89f366f7 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1555 microversion: 2.1 time: 0.143039 Aug 27 04:35:46.246259 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 322/648] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:46 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1555 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:46.752326 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-d1d402cd-dc54-4bba-9443-d311fa7d4903 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:46.752964 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-d1d402cd-dc54-4bba-9443-d311fa7d4903 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:46.758894 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d1d402cd-dc54-4bba-9443-d311fa7d4903 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:46.759338 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d1d402cd-dc54-4bba-9443-d311fa7d4903 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:46.760129 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d1d402cd-dc54-4bba-9443-d311fa7d4903 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:46.760565 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d1d402cd-dc54-4bba-9443-d311fa7d4903 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:46.817858 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-d1d402cd-dc54-4bba-9443-d311fa7d4903 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:46.825007 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-d1d402cd-dc54-4bba-9443-d311fa7d4903 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1137 microversion: 2.1 time: 0.076370 Aug 27 04:35:46.825568 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 327/649] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:46 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1137 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:47.051318 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-011d9600-0d3f-4180-aa4e-9f043bf4446e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:47.051849 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-011d9600-0d3f-4180-aa4e-9f043bf4446e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:47.057800 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-011d9600-0d3f-4180-aa4e-9f043bf4446e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:47.058253 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-011d9600-0d3f-4180-aa4e-9f043bf4446e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:47.059026 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-011d9600-0d3f-4180-aa4e-9f043bf4446e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:47.059465 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-011d9600-0d3f-4180-aa4e-9f043bf4446e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:47.183445 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-011d9600-0d3f-4180-aa4e-9f043bf4446e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:47.192267 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-011d9600-0d3f-4180-aa4e-9f043bf4446e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:47.193780 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-011d9600-0d3f-4180-aa4e-9f043bf4446e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:47.194916 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-011d9600-0d3f-4180-aa4e-9f043bf4446e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1809 microversion: 2.20 time: 0.147412 Aug 27 04:35:47.195476 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 323/650] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:35:47 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1809 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:47.263421 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-f4b31d81-4910-420c-91a8-5c4d930b5297 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:47.264090 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-f4b31d81-4910-420c-91a8-5c4d930b5297 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:47.270620 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f4b31d81-4910-420c-91a8-5c4d930b5297 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:47.271066 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f4b31d81-4910-420c-91a8-5c4d930b5297 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:47.271828 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f4b31d81-4910-420c-91a8-5c4d930b5297 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:47.272326 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f4b31d81-4910-420c-91a8-5c4d930b5297 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:47.393744 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-f4b31d81-4910-420c-91a8-5c4d930b5297 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:47.401465 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-f4b31d81-4910-420c-91a8-5c4d930b5297 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1555 microversion: 2.1 time: 0.141763 Aug 27 04:35:47.402029 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 328/651] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:47 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1555 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:47.842020 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-17158123-2727-410b-874a-ff3d84f62f2e tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:47.842645 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-17158123-2727-410b-874a-ff3d84f62f2e tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:47.848759 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-17158123-2727-410b-874a-ff3d84f62f2e tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:47.849211 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-17158123-2727-410b-874a-ff3d84f62f2e tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:47.849991 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-17158123-2727-410b-874a-ff3d84f62f2e tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:47.850433 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-17158123-2727-410b-874a-ff3d84f62f2e tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:47.907758 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-17158123-2727-410b-874a-ff3d84f62f2e tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:47.914806 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-17158123-2727-410b-874a-ff3d84f62f2e tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1137 microversion: 2.1 time: 0.076508 Aug 27 04:35:47.915369 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 324/652] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:47 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1137 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:48.213445 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-7c6a426b-aaf5-4782-9918-249835a331b0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:48.213968 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-7c6a426b-aaf5-4782-9918-249835a331b0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:48.219853 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7c6a426b-aaf5-4782-9918-249835a331b0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:48.220325 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7c6a426b-aaf5-4782-9918-249835a331b0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:48.221081 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7c6a426b-aaf5-4782-9918-249835a331b0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:48.221519 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7c6a426b-aaf5-4782-9918-249835a331b0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:48.340756 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-7c6a426b-aaf5-4782-9918-249835a331b0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:48.348935 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-7c6a426b-aaf5-4782-9918-249835a331b0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:48.350436 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-7c6a426b-aaf5-4782-9918-249835a331b0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:48.351578 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-7c6a426b-aaf5-4782-9918-249835a331b0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1809 microversion: 2.20 time: 0.141952 Aug 27 04:35:48.352177 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 329/653] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:35:48 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1809 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:48.418834 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-3957419e-93d0-4a2c-baba-d42656e15ebd tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:48.419449 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-3957419e-93d0-4a2c-baba-d42656e15ebd tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:48.425927 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3957419e-93d0-4a2c-baba-d42656e15ebd tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:48.426379 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3957419e-93d0-4a2c-baba-d42656e15ebd tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:48.427138 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3957419e-93d0-4a2c-baba-d42656e15ebd tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:48.427576 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3957419e-93d0-4a2c-baba-d42656e15ebd tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:48.550124 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-3957419e-93d0-4a2c-baba-d42656e15ebd tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:48.557775 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-3957419e-93d0-4a2c-baba-d42656e15ebd tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1555 microversion: 2.1 time: 0.142619 Aug 27 04:35:48.558343 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 325/654] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:48 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1555 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:48.930939 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-b0c4dacd-f568-4a73-b669-b536a9677466 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:48.931463 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-b0c4dacd-f568-4a73-b669-b536a9677466 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:48.937369 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b0c4dacd-f568-4a73-b669-b536a9677466 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:48.937816 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b0c4dacd-f568-4a73-b669-b536a9677466 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:48.938602 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b0c4dacd-f568-4a73-b669-b536a9677466 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:48.939013 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b0c4dacd-f568-4a73-b669-b536a9677466 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:48.996549 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-b0c4dacd-f568-4a73-b669-b536a9677466 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:49.003808 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-b0c4dacd-f568-4a73-b669-b536a9677466 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1137 microversion: 2.1 time: 0.076632 Aug 27 04:35:49.004398 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 330/655] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:48 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1137 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:49.370394 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-b077bc32-a237-4e34-9f11-c177d1b1f7a0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:49.371009 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-b077bc32-a237-4e34-9f11-c177d1b1f7a0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:49.377473 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b077bc32-a237-4e34-9f11-c177d1b1f7a0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:49.377923 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b077bc32-a237-4e34-9f11-c177d1b1f7a0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:49.378683 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b077bc32-a237-4e34-9f11-c177d1b1f7a0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:49.379121 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b077bc32-a237-4e34-9f11-c177d1b1f7a0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:49.501799 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-b077bc32-a237-4e34-9f11-c177d1b1f7a0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:49.509951 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-b077bc32-a237-4e34-9f11-c177d1b1f7a0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:49.511453 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-b077bc32-a237-4e34-9f11-c177d1b1f7a0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:49.512607 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-b077bc32-a237-4e34-9f11-c177d1b1f7a0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1809 microversion: 2.20 time: 0.145983 Aug 27 04:35:49.513167 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 326/656] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:35:49 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1809 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:49.574215 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-6c7a6384-b005-4eca-bd7a-64a1db96a05b tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:49.574827 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-6c7a6384-b005-4eca-bd7a-64a1db96a05b tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:49.581336 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6c7a6384-b005-4eca-bd7a-64a1db96a05b tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:49.581782 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6c7a6384-b005-4eca-bd7a-64a1db96a05b tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:49.582539 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6c7a6384-b005-4eca-bd7a-64a1db96a05b tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:49.582972 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6c7a6384-b005-4eca-bd7a-64a1db96a05b tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:49.702860 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-6c7a6384-b005-4eca-bd7a-64a1db96a05b tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:49.711431 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-6c7a6384-b005-4eca-bd7a-64a1db96a05b tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1555 microversion: 2.1 time: 0.140815 Aug 27 04:35:49.712012 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 331/657] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:49 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1555 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:50.020050 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-31065aa6-b080-485c-aade-350652a89237 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:50.020667 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-31065aa6-b080-485c-aade-350652a89237 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:50.026570 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-31065aa6-b080-485c-aade-350652a89237 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:50.027020 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-31065aa6-b080-485c-aade-350652a89237 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:50.027792 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-31065aa6-b080-485c-aade-350652a89237 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:50.028254 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-31065aa6-b080-485c-aade-350652a89237 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:50.085527 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-31065aa6-b080-485c-aade-350652a89237 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:50.092692 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-31065aa6-b080-485c-aade-350652a89237 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1137 microversion: 2.1 time: 0.076401 Aug 27 04:35:50.093252 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 327/658] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:50 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1137 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:50.531007 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-52f03c74-fd7f-4ba7-b443-c98909f74241 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:50.531635 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-52f03c74-fd7f-4ba7-b443-c98909f74241 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:50.538144 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-52f03c74-fd7f-4ba7-b443-c98909f74241 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:50.538575 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-52f03c74-fd7f-4ba7-b443-c98909f74241 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:50.539325 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-52f03c74-fd7f-4ba7-b443-c98909f74241 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:50.539750 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-52f03c74-fd7f-4ba7-b443-c98909f74241 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:50.656358 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-52f03c74-fd7f-4ba7-b443-c98909f74241 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:50.665090 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-52f03c74-fd7f-4ba7-b443-c98909f74241 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:50.666584 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-52f03c74-fd7f-4ba7-b443-c98909f74241 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:50.667710 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-52f03c74-fd7f-4ba7-b443-c98909f74241 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1809 microversion: 2.20 time: 0.140418 Aug 27 04:35:50.668297 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 332/659] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:35:50 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1809 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:50.728455 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-3a040e33-3d96-4ef5-bd71-81109de054d9 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:50.729066 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-3a040e33-3d96-4ef5-bd71-81109de054d9 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:50.735188 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3a040e33-3d96-4ef5-bd71-81109de054d9 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:50.735755 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3a040e33-3d96-4ef5-bd71-81109de054d9 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:50.736669 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3a040e33-3d96-4ef5-bd71-81109de054d9 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:50.737218 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3a040e33-3d96-4ef5-bd71-81109de054d9 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:50.856291 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-3a040e33-3d96-4ef5-bd71-81109de054d9 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:50.864242 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-3a040e33-3d96-4ef5-bd71-81109de054d9 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1555 microversion: 2.1 time: 0.139124 Aug 27 04:35:50.864798 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 328/660] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:50 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1555 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:35:51.109373 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-8187989b-4ced-43c2-bb8e-3298647e45c4 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:51.109980 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-8187989b-4ced-43c2-bb8e-3298647e45c4 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:51.116626 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8187989b-4ced-43c2-bb8e-3298647e45c4 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:51.117069 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8187989b-4ced-43c2-bb8e-3298647e45c4 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:51.117823 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8187989b-4ced-43c2-bb8e-3298647e45c4 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:51.118252 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8187989b-4ced-43c2-bb8e-3298647e45c4 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:51.175743 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-8187989b-4ced-43c2-bb8e-3298647e45c4 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:51.182828 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-8187989b-4ced-43c2-bb8e-3298647e45c4 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1137 microversion: 2.1 time: 0.077121 Aug 27 04:35:51.183381 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 333/661] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:51 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1137 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:51.685669 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-0cd8a9fa-96a5-4bc6-ab45-7112068f6310 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:51.686197 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-0cd8a9fa-96a5-4bc6-ab45-7112068f6310 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:51.692095 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0cd8a9fa-96a5-4bc6-ab45-7112068f6310 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:51.692550 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0cd8a9fa-96a5-4bc6-ab45-7112068f6310 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:51.693317 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0cd8a9fa-96a5-4bc6-ab45-7112068f6310 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:51.693756 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0cd8a9fa-96a5-4bc6-ab45-7112068f6310 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:51.814608 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-0cd8a9fa-96a5-4bc6-ab45-7112068f6310 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:51.822692 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-0cd8a9fa-96a5-4bc6-ab45-7112068f6310 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:51.824266 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-0cd8a9fa-96a5-4bc6-ab45-7112068f6310 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:51.825400 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-0cd8a9fa-96a5-4bc6-ab45-7112068f6310 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1809 microversion: 2.20 time: 0.143600 Aug 27 04:35:51.825956 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 329/662] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:35:51 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1809 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:51.880981 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-c08a7f65-aa5b-401b-98bb-4baf8a9e3b84 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:51.881588 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-c08a7f65-aa5b-401b-98bb-4baf8a9e3b84 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:51.887383 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c08a7f65-aa5b-401b-98bb-4baf8a9e3b84 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:51.887824 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c08a7f65-aa5b-401b-98bb-4baf8a9e3b84 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:51.888630 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c08a7f65-aa5b-401b-98bb-4baf8a9e3b84 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:51.889062 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c08a7f65-aa5b-401b-98bb-4baf8a9e3b84 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:52.010594 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-c08a7f65-aa5b-401b-98bb-4baf8a9e3b84 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:52.020166 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-c08a7f65-aa5b-401b-98bb-4baf8a9e3b84 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1555 microversion: 2.1 time: 0.142727 Aug 27 04:35:52.020734 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 334/663] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:51 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1555 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:52.199868 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-5d154855-d435-4dc2-97be-037ac0007cac tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:52.200640 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-5d154855-d435-4dc2-97be-037ac0007cac tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:52.207335 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5d154855-d435-4dc2-97be-037ac0007cac tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:52.207798 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5d154855-d435-4dc2-97be-037ac0007cac tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:52.208732 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5d154855-d435-4dc2-97be-037ac0007cac tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:52.209177 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5d154855-d435-4dc2-97be-037ac0007cac tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:52.279757 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-5d154855-d435-4dc2-97be-037ac0007cac tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:52.287922 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-5d154855-d435-4dc2-97be-037ac0007cac tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1203 microversion: 2.1 time: 0.091769 Aug 27 04:35:52.288552 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 330/664] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:52 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1203 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:52.843366 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-ee9e10ed-72f3-4a2f-b704-db8842e567a9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:52.843974 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-ee9e10ed-72f3-4a2f-b704-db8842e567a9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:52.851303 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ee9e10ed-72f3-4a2f-b704-db8842e567a9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:52.851753 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ee9e10ed-72f3-4a2f-b704-db8842e567a9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:52.852560 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ee9e10ed-72f3-4a2f-b704-db8842e567a9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:52.853722 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ee9e10ed-72f3-4a2f-b704-db8842e567a9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:52.989663 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-ee9e10ed-72f3-4a2f-b704-db8842e567a9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:52.998589 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-ee9e10ed-72f3-4a2f-b704-db8842e567a9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:53.000181 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-ee9e10ed-72f3-4a2f-b704-db8842e567a9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:53.002159 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-ee9e10ed-72f3-4a2f-b704-db8842e567a9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1809 microversion: 2.20 time: 0.162667 Aug 27 04:35:53.002714 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 335/665] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:35:52 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:53.037635 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-07939ce1-8346-4c3a-a0b0-5c832714bd7a tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:53.038278 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-07939ce1-8346-4c3a-a0b0-5c832714bd7a tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:53.044129 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-07939ce1-8346-4c3a-a0b0-5c832714bd7a tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:53.044581 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-07939ce1-8346-4c3a-a0b0-5c832714bd7a tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:53.045347 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-07939ce1-8346-4c3a-a0b0-5c832714bd7a tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:53.045791 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-07939ce1-8346-4c3a-a0b0-5c832714bd7a tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:53.305144 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-26d45c70-8b4d-427c-8eab-85f4b38f617f tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:53.305885 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-26d45c70-8b4d-427c-8eab-85f4b38f617f tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:53.312395 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-26d45c70-8b4d-427c-8eab-85f4b38f617f tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:53.312917 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-26d45c70-8b4d-427c-8eab-85f4b38f617f tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:53.314324 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-26d45c70-8b4d-427c-8eab-85f4b38f617f tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:53.314761 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-26d45c70-8b4d-427c-8eab-85f4b38f617f tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:53.448752 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-26d45c70-8b4d-427c-8eab-85f4b38f617f tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:53.456748 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-26d45c70-8b4d-427c-8eab-85f4b38f617f tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1271 microversion: 2.1 time: 0.155731 Aug 27 04:35:53.457317 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 336/666] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:53 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1271 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:35:53.472999 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-07939ce1-8346-4c3a-a0b0-5c832714bd7a tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:53.480989 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-07939ce1-8346-4c3a-a0b0-5c832714bd7a tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1555 microversion: 2.1 time: 0.447070 Aug 27 04:35:53.481565 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 331/667] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:53 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1555 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:53.994731 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [req-30a38e59-2a28-4fa6-bb61-dfb7d3975675 req-e0b7ecc6-c40c-45ed-9fe0-35b611558682 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2051c4e-353b-4875-8217-513125bcaf66", "tag": "236b6127-484d-477e-b8eb-9cc2f556a39e"}]} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:35:53.996712 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:35:53.996712 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: warnings.warn(msg) Aug 27 04:35:54.004969 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-30a38e59-2a28-4fa6-bb61-dfb7d3975675 req-e0b7ecc6-c40c-45ed-9fe0-35b611558682 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:54.005747 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-30a38e59-2a28-4fa6-bb61-dfb7d3975675 req-e0b7ecc6-c40c-45ed-9fe0-35b611558682 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:54.020586 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-3e77e257-819b-4a33-a847-6a6e4b479aca tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:54.021424 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-3e77e257-819b-4a33-a847-6a6e4b479aca tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:54.030234 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3e77e257-819b-4a33-a847-6a6e4b479aca tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:54.033566 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.compute.server_external_events [req-30a38e59-2a28-4fa6-bb61-dfb7d3975675 req-e0b7ecc6-c40c-45ed-9fe0-35b611558682 service nova] Creating event network-changed:236b6127-484d-477e-b8eb-9cc2f556a39e for instance e2051c4e-353b-4875-8217-513125bcaf66 on hv-cinder-80403 Aug 27 04:35:54.039764 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3e77e257-819b-4a33-a847-6a6e4b479aca tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:54.041409 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3e77e257-819b-4a33-a847-6a6e4b479aca tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:54.042021 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3e77e257-819b-4a33-a847-6a6e4b479aca tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:54.056395 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [req-30a38e59-2a28-4fa6-bb61-dfb7d3975675 req-e0b7ecc6-c40c-45ed-9fe0-35b611558682 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065631 Aug 27 04:35:54.057699 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 337/668] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:35:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:35:54.239401 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-3e77e257-819b-4a33-a847-6a6e4b479aca tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:54.248919 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-3e77e257-819b-4a33-a847-6a6e4b479aca tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:54.250538 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-3e77e257-819b-4a33-a847-6a6e4b479aca tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:54.251914 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-3e77e257-819b-4a33-a847-6a6e4b479aca tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1809 microversion: 2.20 time: 0.235778 Aug 27 04:35:54.252678 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 332/669] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:35:54 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1809 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:35:54.474223 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-f5ff4c7d-7fe9-4798-a79f-45ee2daacd8c tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:54.474918 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-f5ff4c7d-7fe9-4798-a79f-45ee2daacd8c tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:54.480944 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f5ff4c7d-7fe9-4798-a79f-45ee2daacd8c tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:54.481387 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f5ff4c7d-7fe9-4798-a79f-45ee2daacd8c tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:54.482145 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f5ff4c7d-7fe9-4798-a79f-45ee2daacd8c tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:54.482575 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f5ff4c7d-7fe9-4798-a79f-45ee2daacd8c tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:54.498535 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-169df845-59a8-4fba-867d-5f5bb7e51b80 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:54.499403 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-169df845-59a8-4fba-867d-5f5bb7e51b80 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:54.506200 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-169df845-59a8-4fba-867d-5f5bb7e51b80 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:54.506745 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-169df845-59a8-4fba-867d-5f5bb7e51b80 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:54.507599 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-169df845-59a8-4fba-867d-5f5bb7e51b80 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:54.508149 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-169df845-59a8-4fba-867d-5f5bb7e51b80 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:54.636996 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-169df845-59a8-4fba-867d-5f5bb7e51b80 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:54.645328 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-169df845-59a8-4fba-867d-5f5bb7e51b80 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1561 microversion: 2.1 time: 0.150558 Aug 27 04:35:54.645907 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 333/670] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:54 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:35:54.661603 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-f5ff4c7d-7fe9-4798-a79f-45ee2daacd8c tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:54.668925 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-f5ff4c7d-7fe9-4798-a79f-45ee2daacd8c tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1259 microversion: 2.1 time: 0.199459 Aug 27 04:35:54.669490 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 338/671] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:54 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1259 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:54.718852 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-31861889-9130-4713-874b-c8432662c54d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:54.719348 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-31861889-9130-4713-874b-c8432662c54d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:54.725805 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-31861889-9130-4713-874b-c8432662c54d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:54.726258 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-31861889-9130-4713-874b-c8432662c54d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:54.727058 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-31861889-9130-4713-874b-c8432662c54d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:54.727499 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-31861889-9130-4713-874b-c8432662c54d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:54.949401 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.objects.instance [None req-31861889-9130-4713-874b-c8432662c54d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lazy-loading 'services' on Instance uuid 0e594817-f3cc-40e6-babe-c736641fb9a9 {{(pid=108970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:35:55.055862 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-31861889-9130-4713-874b-c8432662c54d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "DELETE /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9/os-volume_attachments/9328bfc8-6924-4104-a547-533aa4493cae" status: 202 len: 0 microversion: 2.1 time: 0.340523 Aug 27 04:35:55.056588 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 334/672] 10.222.0.53 () {58 vars in 1416 bytes} [Fri Aug 27 04:35:54 2021] DELETE /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9/os-volume_attachments/9328bfc8-6924-4104-a547-533aa4493cae => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:35:55.066081 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-7d30ae3f-f089-48ac-956f-b60731baaead tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:55.067587 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-7d30ae3f-f089-48ac-956f-b60731baaead tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:55.073696 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7d30ae3f-f089-48ac-956f-b60731baaead tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:55.074612 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7d30ae3f-f089-48ac-956f-b60731baaead tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:55.075233 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7d30ae3f-f089-48ac-956f-b60731baaead tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:55.075808 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7d30ae3f-f089-48ac-956f-b60731baaead tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:55.107269 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-7d30ae3f-f089-48ac-956f-b60731baaead tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046179 Aug 27 04:35:55.107829 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 339/673] 10.222.0.53 () {58 vars in 1302 bytes} [Fri Aug 27 04:35:55 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:35:55.270683 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-2cacf98e-3bec-4f8e-b134-1e5993c70332 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:55.271382 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-2cacf98e-3bec-4f8e-b134-1e5993c70332 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:55.277661 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2cacf98e-3bec-4f8e-b134-1e5993c70332 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:55.278114 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2cacf98e-3bec-4f8e-b134-1e5993c70332 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:55.278891 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2cacf98e-3bec-4f8e-b134-1e5993c70332 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:55.279332 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2cacf98e-3bec-4f8e-b134-1e5993c70332 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:55.406710 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-2cacf98e-3bec-4f8e-b134-1e5993c70332 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:55.415417 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-2cacf98e-3bec-4f8e-b134-1e5993c70332 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:55.416961 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-2cacf98e-3bec-4f8e-b134-1e5993c70332 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:55.418097 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-2cacf98e-3bec-4f8e-b134-1e5993c70332 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1809 microversion: 2.20 time: 0.151531 Aug 27 04:35:55.418658 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 335/674] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:35:55 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:55.686077 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-2099ef5e-9e7b-4c09-9057-a79b5c707a1e tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:55.686597 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-2099ef5e-9e7b-4c09-9057-a79b5c707a1e tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:55.692666 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-2099ef5e-9e7b-4c09-9057-a79b5c707a1e tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:55.693104 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-2099ef5e-9e7b-4c09-9057-a79b5c707a1e tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:55.693866 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-2099ef5e-9e7b-4c09-9057-a79b5c707a1e tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:55.694293 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-2099ef5e-9e7b-4c09-9057-a79b5c707a1e tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:55.811919 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-2099ef5e-9e7b-4c09-9057-a79b5c707a1e tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:55.819336 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-2099ef5e-9e7b-4c09-9057-a79b5c707a1e tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1259 microversion: 2.1 time: 0.136951 Aug 27 04:35:55.819904 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 340/675] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:55 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1259 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:56.119346 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-970f17b3-d600-4fef-a143-655c5f963c6f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:56.120688 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-970f17b3-d600-4fef-a143-655c5f963c6f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:56.127102 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-970f17b3-d600-4fef-a143-655c5f963c6f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:56.127554 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-970f17b3-d600-4fef-a143-655c5f963c6f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:56.128345 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-970f17b3-d600-4fef-a143-655c5f963c6f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:56.128786 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-970f17b3-d600-4fef-a143-655c5f963c6f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:56.157282 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-970f17b3-d600-4fef-a143-655c5f963c6f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041657 Aug 27 04:35:56.157829 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 336/676] 10.222.0.53 () {58 vars in 1302 bytes} [Fri Aug 27 04:35:56 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:35:56.435721 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-7ef881d9-f836-4b30-a531-e9d7beffe32f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:56.436354 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-7ef881d9-f836-4b30-a531-e9d7beffe32f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:56.442859 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7ef881d9-f836-4b30-a531-e9d7beffe32f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:56.443307 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7ef881d9-f836-4b30-a531-e9d7beffe32f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:56.444097 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7ef881d9-f836-4b30-a531-e9d7beffe32f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:56.444536 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7ef881d9-f836-4b30-a531-e9d7beffe32f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:56.562711 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-7ef881d9-f836-4b30-a531-e9d7beffe32f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:56.570832 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-7ef881d9-f836-4b30-a531-e9d7beffe32f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:56.572361 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-7ef881d9-f836-4b30-a531-e9d7beffe32f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:56.573519 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-7ef881d9-f836-4b30-a531-e9d7beffe32f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1809 microversion: 2.20 time: 0.141460 Aug 27 04:35:56.574047 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 341/677] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:35:56 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1809 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:56.835641 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-0ba04615-2400-4f4b-9eb0-e26a7999cbcf tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:56.836281 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-0ba04615-2400-4f4b-9eb0-e26a7999cbcf tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:56.842117 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0ba04615-2400-4f4b-9eb0-e26a7999cbcf tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:56.842586 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0ba04615-2400-4f4b-9eb0-e26a7999cbcf tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:56.843329 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0ba04615-2400-4f4b-9eb0-e26a7999cbcf tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:56.843774 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0ba04615-2400-4f4b-9eb0-e26a7999cbcf tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:56.960898 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-0ba04615-2400-4f4b-9eb0-e26a7999cbcf tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:56.968124 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-0ba04615-2400-4f4b-9eb0-e26a7999cbcf tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1259 microversion: 2.1 time: 0.136159 Aug 27 04:35:56.968687 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 337/678] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:56 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1259 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:57.168678 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-3aa43496-e312-4f30-aa7e-772aefe656ee tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:57.169519 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-3aa43496-e312-4f30-aa7e-772aefe656ee tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:57.175916 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3aa43496-e312-4f30-aa7e-772aefe656ee tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:57.176440 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3aa43496-e312-4f30-aa7e-772aefe656ee tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:57.177238 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3aa43496-e312-4f30-aa7e-772aefe656ee tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:57.177649 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3aa43496-e312-4f30-aa7e-772aefe656ee tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:57.206221 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-3aa43496-e312-4f30-aa7e-772aefe656ee tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041340 Aug 27 04:35:57.206782 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 342/679] 10.222.0.53 () {58 vars in 1302 bytes} [Fri Aug 27 04:35:57 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:35:57.592338 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-19b7733c-c9f6-4a99-8378-e89da32018ff tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:57.592950 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-19b7733c-c9f6-4a99-8378-e89da32018ff tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:57.599228 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-19b7733c-c9f6-4a99-8378-e89da32018ff tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:57.599681 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-19b7733c-c9f6-4a99-8378-e89da32018ff tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:57.600483 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-19b7733c-c9f6-4a99-8378-e89da32018ff tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:57.600921 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-19b7733c-c9f6-4a99-8378-e89da32018ff tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:57.717299 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-19b7733c-c9f6-4a99-8378-e89da32018ff tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:57.725926 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-19b7733c-c9f6-4a99-8378-e89da32018ff tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:57.727435 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-19b7733c-c9f6-4a99-8378-e89da32018ff tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:57.728650 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-19b7733c-c9f6-4a99-8378-e89da32018ff tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1809 microversion: 2.20 time: 0.139973 Aug 27 04:35:57.729210 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 338/680] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:35:57 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1809 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:57.984685 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-fb9a3df4-c5a7-4059-8c31-e89eb6f5d3f8 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:57.985286 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-fb9a3df4-c5a7-4059-8c31-e89eb6f5d3f8 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:57.991312 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-fb9a3df4-c5a7-4059-8c31-e89eb6f5d3f8 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:57.991754 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-fb9a3df4-c5a7-4059-8c31-e89eb6f5d3f8 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:57.992612 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-fb9a3df4-c5a7-4059-8c31-e89eb6f5d3f8 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:57.993070 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-fb9a3df4-c5a7-4059-8c31-e89eb6f5d3f8 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:58.112150 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-fb9a3df4-c5a7-4059-8c31-e89eb6f5d3f8 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:58.119702 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-fb9a3df4-c5a7-4059-8c31-e89eb6f5d3f8 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1259 microversion: 2.1 time: 0.138589 Aug 27 04:35:58.120337 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 343/681] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:57 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1259 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:58.747545 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-11885d7f-094d-4315-9105-01a55a8a2bd9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:58.748205 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-11885d7f-094d-4315-9105-01a55a8a2bd9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:58.754559 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-11885d7f-094d-4315-9105-01a55a8a2bd9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:58.755002 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-11885d7f-094d-4315-9105-01a55a8a2bd9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:58.755753 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-11885d7f-094d-4315-9105-01a55a8a2bd9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:58.756209 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-11885d7f-094d-4315-9105-01a55a8a2bd9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:58.879229 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-11885d7f-094d-4315-9105-01a55a8a2bd9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:58.887264 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-11885d7f-094d-4315-9105-01a55a8a2bd9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:58.888922 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-11885d7f-094d-4315-9105-01a55a8a2bd9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:58.890048 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-11885d7f-094d-4315-9105-01a55a8a2bd9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1809 microversion: 2.20 time: 0.146373 Aug 27 04:35:58.890597 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 339/682] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:35:58 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1809 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:35:59.136436 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-a390dd23-2d30-4832-a8b9-02425241fbcf tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:59.137038 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-a390dd23-2d30-4832-a8b9-02425241fbcf tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:59.142821 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a390dd23-2d30-4832-a8b9-02425241fbcf tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:59.143254 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a390dd23-2d30-4832-a8b9-02425241fbcf tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:59.144015 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a390dd23-2d30-4832-a8b9-02425241fbcf tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:59.144445 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a390dd23-2d30-4832-a8b9-02425241fbcf tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:59.262014 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-a390dd23-2d30-4832-a8b9-02425241fbcf tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:59.269716 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-a390dd23-2d30-4832-a8b9-02425241fbcf tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1259 microversion: 2.1 time: 0.136875 Aug 27 04:35:59.270269 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 344/683] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:59 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1259 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:59.522721 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-67368b2b-6f6c-4630-aad4-61d747fc1e35 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:59.523240 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-67368b2b-6f6c-4630-aad4-61d747fc1e35 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:59.529021 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-67368b2b-6f6c-4630-aad4-61d747fc1e35 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:59.529495 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-67368b2b-6f6c-4630-aad4-61d747fc1e35 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:59.530257 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-67368b2b-6f6c-4630-aad4-61d747fc1e35 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:59.530694 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-67368b2b-6f6c-4630-aad4-61d747fc1e35 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:59.554649 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-67368b2b-6f6c-4630-aad4-61d747fc1e35 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Going to try to terminate instance {{(pid=108970) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 04:35:59.627627 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-67368b2b-6f6c-4630-aad4-61d747fc1e35 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "DELETE /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 204 len: 0 microversion: 2.1 time: 0.108163 Aug 27 04:35:59.628178 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 340/684] 10.222.0.53 () {58 vars in 1239 bytes} [Fri Aug 27 04:35:59 2021] DELETE /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:35:59.635872 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-3fa34890-286b-4ff2-b84d-2ab05dd2c299 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:59.636508 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-3fa34890-286b-4ff2-b84d-2ab05dd2c299 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:59.642306 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3fa34890-286b-4ff2-b84d-2ab05dd2c299 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:59.642734 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3fa34890-286b-4ff2-b84d-2ab05dd2c299 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:59.643492 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3fa34890-286b-4ff2-b84d-2ab05dd2c299 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:59.643924 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3fa34890-286b-4ff2-b84d-2ab05dd2c299 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:59.760631 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-3fa34890-286b-4ff2-b84d-2ab05dd2c299 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:35:59.767842 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-3fa34890-286b-4ff2-b84d-2ab05dd2c299 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1508 microversion: 2.1 time: 0.135617 Aug 27 04:35:59.768432 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 345/685] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:35:59 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1508 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:35:59.908908 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-066fe6d9-a8aa-4d2e-91ef-74ed3701bc31 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:35:59.909534 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-066fe6d9-a8aa-4d2e-91ef-74ed3701bc31 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:35:59.915590 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-066fe6d9-a8aa-4d2e-91ef-74ed3701bc31 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:59.916083 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-066fe6d9-a8aa-4d2e-91ef-74ed3701bc31 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:35:59.916891 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-066fe6d9-a8aa-4d2e-91ef-74ed3701bc31 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:35:59.917335 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-066fe6d9-a8aa-4d2e-91ef-74ed3701bc31 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:00.041556 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-066fe6d9-a8aa-4d2e-91ef-74ed3701bc31 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:00.050479 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-066fe6d9-a8aa-4d2e-91ef-74ed3701bc31 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:00.052028 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-066fe6d9-a8aa-4d2e-91ef-74ed3701bc31 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:00.053179 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-066fe6d9-a8aa-4d2e-91ef-74ed3701bc31 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1809 microversion: 2.20 time: 0.148935 Aug 27 04:36:00.053735 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 341/686] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:35:59 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1809 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:36:00.286598 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-0899a234-2e8c-41fe-ade0-ff8ad0031cbf tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:00.287237 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-0899a234-2e8c-41fe-ade0-ff8ad0031cbf tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:36:00.293076 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0899a234-2e8c-41fe-ade0-ff8ad0031cbf tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:00.293515 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0899a234-2e8c-41fe-ade0-ff8ad0031cbf tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:00.294266 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0899a234-2e8c-41fe-ade0-ff8ad0031cbf tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:00.294687 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0899a234-2e8c-41fe-ade0-ff8ad0031cbf tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:00.426657 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-0899a234-2e8c-41fe-ade0-ff8ad0031cbf tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:00.433910 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-0899a234-2e8c-41fe-ade0-ff8ad0031cbf tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1259 microversion: 2.1 time: 0.150935 Aug 27 04:36:00.434470 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 346/687] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:36:00 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:00.785239 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-ab19c1a0-561f-4afd-b11c-6b0d781c96a4 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:00.785840 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-ab19c1a0-561f-4afd-b11c-6b0d781c96a4 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:36:00.791634 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ab19c1a0-561f-4afd-b11c-6b0d781c96a4 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:00.792108 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ab19c1a0-561f-4afd-b11c-6b0d781c96a4 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:00.792862 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ab19c1a0-561f-4afd-b11c-6b0d781c96a4 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:00.793290 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ab19c1a0-561f-4afd-b11c-6b0d781c96a4 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:00.912614 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-ab19c1a0-561f-4afd-b11c-6b0d781c96a4 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:00.919799 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-ab19c1a0-561f-4afd-b11c-6b0d781c96a4 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1508 microversion: 2.1 time: 0.138656 Aug 27 04:36:00.920384 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 342/688] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:36:00 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1508 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:01.070323 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-80be8d11-88ab-4869-b15d-27fa2a48d668 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:01.070854 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-80be8d11-88ab-4869-b15d-27fa2a48d668 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:36:01.076691 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-80be8d11-88ab-4869-b15d-27fa2a48d668 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:01.077127 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-80be8d11-88ab-4869-b15d-27fa2a48d668 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:01.077875 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-80be8d11-88ab-4869-b15d-27fa2a48d668 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:01.078300 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-80be8d11-88ab-4869-b15d-27fa2a48d668 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:01.197013 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-80be8d11-88ab-4869-b15d-27fa2a48d668 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:01.205732 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-80be8d11-88ab-4869-b15d-27fa2a48d668 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:01.207223 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-80be8d11-88ab-4869-b15d-27fa2a48d668 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:01.208408 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-80be8d11-88ab-4869-b15d-27fa2a48d668 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1809 microversion: 2.20 time: 0.141737 Aug 27 04:36:01.208970 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 347/689] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:36:01 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1809 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:36:01.450673 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-4c488c90-1512-42f6-aac7-04132b887e52 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:01.451333 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-4c488c90-1512-42f6-aac7-04132b887e52 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:36:01.457849 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4c488c90-1512-42f6-aac7-04132b887e52 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:01.458305 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4c488c90-1512-42f6-aac7-04132b887e52 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:01.459070 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4c488c90-1512-42f6-aac7-04132b887e52 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:01.459511 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4c488c90-1512-42f6-aac7-04132b887e52 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:01.582324 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-4c488c90-1512-42f6-aac7-04132b887e52 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:01.591164 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-4c488c90-1512-42f6-aac7-04132b887e52 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1259 microversion: 2.1 time: 0.144147 Aug 27 04:36:01.591724 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 343/690] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:36:01 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1259 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:01.936021 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-f22dd627-2a2e-43e3-8eba-51258182f22f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:01.936574 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-f22dd627-2a2e-43e3-8eba-51258182f22f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:36:01.943077 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f22dd627-2a2e-43e3-8eba-51258182f22f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:01.943512 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f22dd627-2a2e-43e3-8eba-51258182f22f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:01.944288 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f22dd627-2a2e-43e3-8eba-51258182f22f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:01.944718 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f22dd627-2a2e-43e3-8eba-51258182f22f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:02.061402 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-f22dd627-2a2e-43e3-8eba-51258182f22f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:02.068551 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-f22dd627-2a2e-43e3-8eba-51258182f22f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1508 microversion: 2.1 time: 0.136309 Aug 27 04:36:02.069107 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 348/691] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:36:01 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1508 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:02.226226 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-2c232080-56da-4c2a-ac6c-df2d43526ee3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:02.226743 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-2c232080-56da-4c2a-ac6c-df2d43526ee3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:36:02.232555 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2c232080-56da-4c2a-ac6c-df2d43526ee3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:02.233003 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2c232080-56da-4c2a-ac6c-df2d43526ee3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:02.233765 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2c232080-56da-4c2a-ac6c-df2d43526ee3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:02.234195 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2c232080-56da-4c2a-ac6c-df2d43526ee3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:02.352229 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-2c232080-56da-4c2a-ac6c-df2d43526ee3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:02.360903 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-2c232080-56da-4c2a-ac6c-df2d43526ee3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:02.362386 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-2c232080-56da-4c2a-ac6c-df2d43526ee3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:02.363514 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-2c232080-56da-4c2a-ac6c-df2d43526ee3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1809 microversion: 2.20 time: 0.141139 Aug 27 04:36:02.364363 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 344/692] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:36:02 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1809 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:36:02.607119 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-1d5faf4d-1db1-43f4-b45f-f919787f8794 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:02.607725 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-1d5faf4d-1db1-43f4-b45f-f919787f8794 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:36:02.614580 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1d5faf4d-1db1-43f4-b45f-f919787f8794 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:02.615024 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1d5faf4d-1db1-43f4-b45f-f919787f8794 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:02.615796 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1d5faf4d-1db1-43f4-b45f-f919787f8794 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:02.616261 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1d5faf4d-1db1-43f4-b45f-f919787f8794 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:02.735272 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-1d5faf4d-1db1-43f4-b45f-f919787f8794 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:02.742798 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-1d5faf4d-1db1-43f4-b45f-f919787f8794 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1259 microversion: 2.1 time: 0.139337 Aug 27 04:36:02.743362 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 349/693] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:36:02 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1259 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:03.085221 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-2ea01e6d-6c43-4af3-9b05-69cfc8f45de8 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:03.085832 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-2ea01e6d-6c43-4af3-9b05-69cfc8f45de8 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:36:03.091828 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2ea01e6d-6c43-4af3-9b05-69cfc8f45de8 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:03.092309 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2ea01e6d-6c43-4af3-9b05-69cfc8f45de8 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:03.093069 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2ea01e6d-6c43-4af3-9b05-69cfc8f45de8 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:03.093501 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2ea01e6d-6c43-4af3-9b05-69cfc8f45de8 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:03.220222 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-2ea01e6d-6c43-4af3-9b05-69cfc8f45de8 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:03.228155 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-2ea01e6d-6c43-4af3-9b05-69cfc8f45de8 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1508 microversion: 2.1 time: 0.146506 Aug 27 04:36:03.228714 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 345/694] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:36:03 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1508 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:03.381804 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-32f8968a-3396-4a9d-802a-cac4ed1140f1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:03.382407 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-32f8968a-3396-4a9d-802a-cac4ed1140f1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:36:03.388280 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-32f8968a-3396-4a9d-802a-cac4ed1140f1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:03.388718 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-32f8968a-3396-4a9d-802a-cac4ed1140f1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:03.389476 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-32f8968a-3396-4a9d-802a-cac4ed1140f1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:03.389905 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-32f8968a-3396-4a9d-802a-cac4ed1140f1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:03.510637 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-32f8968a-3396-4a9d-802a-cac4ed1140f1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:03.519283 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-32f8968a-3396-4a9d-802a-cac4ed1140f1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:03.520821 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-32f8968a-3396-4a9d-802a-cac4ed1140f1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:03.521931 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-32f8968a-3396-4a9d-802a-cac4ed1140f1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1809 microversion: 2.20 time: 0.143879 Aug 27 04:36:03.522486 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 350/695] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:36:03 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1809 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:36:03.759757 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-cafc15c2-719e-40de-91ab-90ed206aaf28 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:03.760431 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-cafc15c2-719e-40de-91ab-90ed206aaf28 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:36:03.769391 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-cafc15c2-719e-40de-91ab-90ed206aaf28 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:03.769839 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-cafc15c2-719e-40de-91ab-90ed206aaf28 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:03.770620 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-cafc15c2-719e-40de-91ab-90ed206aaf28 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:03.771059 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-cafc15c2-719e-40de-91ab-90ed206aaf28 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:03.893801 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-cafc15c2-719e-40de-91ab-90ed206aaf28 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:03.900972 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-cafc15c2-719e-40de-91ab-90ed206aaf28 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1259 microversion: 2.1 time: 0.144923 Aug 27 04:36:03.901534 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 346/696] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:36:03 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1259 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:04.245376 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-56b80cd4-110d-4472-877d-dc6537b08098 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:04.245897 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-56b80cd4-110d-4472-877d-dc6537b08098 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:36:04.252340 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-56b80cd4-110d-4472-877d-dc6537b08098 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:04.252789 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-56b80cd4-110d-4472-877d-dc6537b08098 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:04.253559 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-56b80cd4-110d-4472-877d-dc6537b08098 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:04.253998 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-56b80cd4-110d-4472-877d-dc6537b08098 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:04.371689 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-56b80cd4-110d-4472-877d-dc6537b08098 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:04.381425 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-56b80cd4-110d-4472-877d-dc6537b08098 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1508 microversion: 2.1 time: 0.139632 Aug 27 04:36:04.382265 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 351/697] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:36:04 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1508 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:04.539930 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-02bb07b2-8a19-4220-bc59-70ddbc399411 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:04.540567 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-02bb07b2-8a19-4220-bc59-70ddbc399411 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:36:04.546365 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-02bb07b2-8a19-4220-bc59-70ddbc399411 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:04.546820 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-02bb07b2-8a19-4220-bc59-70ddbc399411 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:04.548269 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-02bb07b2-8a19-4220-bc59-70ddbc399411 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:04.548710 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-02bb07b2-8a19-4220-bc59-70ddbc399411 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:04.763725 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-02bb07b2-8a19-4220-bc59-70ddbc399411 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:04.772611 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-02bb07b2-8a19-4220-bc59-70ddbc399411 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:04.774095 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-02bb07b2-8a19-4220-bc59-70ddbc399411 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:04.775236 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-02bb07b2-8a19-4220-bc59-70ddbc399411 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1809 microversion: 2.20 time: 0.239107 Aug 27 04:36:04.775793 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 347/698] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:36:04 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1809 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:36:04.917360 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-7a88bb12-6245-434c-843a-012dcd1fea04 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:04.917972 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-7a88bb12-6245-434c-843a-012dcd1fea04 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:36:04.924257 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7a88bb12-6245-434c-843a-012dcd1fea04 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:04.924703 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7a88bb12-6245-434c-843a-012dcd1fea04 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:04.925470 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7a88bb12-6245-434c-843a-012dcd1fea04 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:04.925902 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7a88bb12-6245-434c-843a-012dcd1fea04 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:05.044339 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [req-fe252542-b791-4f22-8d72-abbc789edae3 req-e3fa2fdb-9c37-4afa-8cf3-324749dc5311 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df8098ad-7c9c-4ba5-992d-392f9cd1742a", "name": "network-vif-deleted", "tag": "c3463dab-7cf3-45d8-9707-77a461c168a9"}]} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:36:05.046298 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:36:05.046298 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: warnings.warn(msg) Aug 27 04:36:05.054086 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-fe252542-b791-4f22-8d72-abbc789edae3 req-e3fa2fdb-9c37-4afa-8cf3-324749dc5311 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:05.054847 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-fe252542-b791-4f22-8d72-abbc789edae3 req-e3fa2fdb-9c37-4afa-8cf3-324749dc5311 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:05.066278 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.compute.server_external_events [req-fe252542-b791-4f22-8d72-abbc789edae3 req-e3fa2fdb-9c37-4afa-8cf3-324749dc5311 service nova] Creating event network-vif-deleted:c3463dab-7cf3-45d8-9707-77a461c168a9 for instance df8098ad-7c9c-4ba5-992d-392f9cd1742a on hv-cinder-80403 Aug 27 04:36:05.071195 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [req-fe252542-b791-4f22-8d72-abbc789edae3 req-e3fa2fdb-9c37-4afa-8cf3-324749dc5311 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030392 Aug 27 04:36:05.072421 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 348/699] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:36:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:36:05.155345 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-7a88bb12-6245-434c-843a-012dcd1fea04 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:05.165225 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-7a88bb12-6245-434c-843a-012dcd1fea04 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1259 microversion: 2.1 time: 0.251256 Aug 27 04:36:05.167484 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 352/700] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:36:04 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1259 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:05.398595 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-7203c006-8fe8-464f-92df-aa2f8bb2696f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:05.399393 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-7203c006-8fe8-464f-92df-aa2f8bb2696f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:36:05.405992 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7203c006-8fe8-464f-92df-aa2f8bb2696f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:05.406604 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7203c006-8fe8-464f-92df-aa2f8bb2696f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:05.407460 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7203c006-8fe8-464f-92df-aa2f8bb2696f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:05.408030 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7203c006-8fe8-464f-92df-aa2f8bb2696f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:05.443448 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7203c006-8fe8-464f-92df-aa2f8bb2696f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:05.444256 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7203c006-8fe8-464f-92df-aa2f8bb2696f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:05.444813 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.objects.instance [None req-7203c006-8fe8-464f-92df-aa2f8bb2696f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lazy-loading 'fault' on Instance uuid df8098ad-7c9c-4ba5-992d-392f9cd1742a {{(pid=108970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:36:05.489307 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [req-97e3d158-186a-475c-8074-1494c274a28a req-ba8b2b24-7104-4ff4-b462-257d1497f414 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3173859-725e-4d66-80af-4223a6643935", "name": "network-vif-plugged", "status": "completed", "tag": "698af269-46a5-4892-822b-9ef4aa21fa2e"}]} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:36:05.491846 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:36:05.491846 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: warnings.warn(msg) Aug 27 04:36:05.498484 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-7203c006-8fe8-464f-92df-aa2f8bb2696f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:05.507111 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-97e3d158-186a-475c-8074-1494c274a28a req-ba8b2b24-7104-4ff4-b462-257d1497f414 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:05.507782 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-97e3d158-186a-475c-8074-1494c274a28a req-ba8b2b24-7104-4ff4-b462-257d1497f414 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:05.509487 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-7203c006-8fe8-464f-92df-aa2f8bb2696f tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 200 len: 1312 microversion: 2.1 time: 0.114813 Aug 27 04:36:05.519586 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 349/701] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:36:05 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 1312 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:05.527191 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.compute.server_external_events [req-97e3d158-186a-475c-8074-1494c274a28a req-ba8b2b24-7104-4ff4-b462-257d1497f414 service nova] Creating event network-vif-plugged:698af269-46a5-4892-822b-9ef4aa21fa2e for instance b3173859-725e-4d66-80af-4223a6643935 on hv-cinder-80403 Aug 27 04:36:05.532892 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [req-97e3d158-186a-475c-8074-1494c274a28a req-ba8b2b24-7104-4ff4-b462-257d1497f414 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050053 Aug 27 04:36:05.533502 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 353/702] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:36:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:36:05.793846 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-84ba35bb-55d4-45c6-8ecc-1a9ca521b01e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:05.794484 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-84ba35bb-55d4-45c6-8ecc-1a9ca521b01e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:36:05.800822 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-84ba35bb-55d4-45c6-8ecc-1a9ca521b01e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:05.801292 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-84ba35bb-55d4-45c6-8ecc-1a9ca521b01e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:05.802106 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-84ba35bb-55d4-45c6-8ecc-1a9ca521b01e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:05.802770 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-84ba35bb-55d4-45c6-8ecc-1a9ca521b01e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:05.935712 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-84ba35bb-55d4-45c6-8ecc-1a9ca521b01e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:05.944032 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-84ba35bb-55d4-45c6-8ecc-1a9ca521b01e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:05.945527 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-84ba35bb-55d4-45c6-8ecc-1a9ca521b01e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:05.946742 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-84ba35bb-55d4-45c6-8ecc-1a9ca521b01e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1809 microversion: 2.20 time: 0.156617 Aug 27 04:36:05.947312 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 350/703] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:36:05 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:36:06.183789 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-9ac99bfc-b186-4856-a0a3-462ecd64621d tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:06.184494 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-9ac99bfc-b186-4856-a0a3-462ecd64621d tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:36:06.190469 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9ac99bfc-b186-4856-a0a3-462ecd64621d tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:06.190911 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9ac99bfc-b186-4856-a0a3-462ecd64621d tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:06.191684 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9ac99bfc-b186-4856-a0a3-462ecd64621d tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:06.192284 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9ac99bfc-b186-4856-a0a3-462ecd64621d tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:06.337040 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-9ac99bfc-b186-4856-a0a3-462ecd64621d tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:06.344862 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-9ac99bfc-b186-4856-a0a3-462ecd64621d tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1259 microversion: 2.1 time: 0.164495 Aug 27 04:36:06.345417 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 354/704] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:36:06 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:06.526373 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-e321992c-8bab-4600-861c-34b40812be97 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:06.526975 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-e321992c-8bab-4600-861c-34b40812be97 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: df8098ad-7c9c-4ba5-992d-392f9cd1742a] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:36:06.532912 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e321992c-8bab-4600-861c-34b40812be97 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:06.533351 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e321992c-8bab-4600-861c-34b40812be97 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:06.534106 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e321992c-8bab-4600-861c-34b40812be97 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:06.534537 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e321992c-8bab-4600-861c-34b40812be97 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:06.547371 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.wsgi [None req-e321992c-8bab-4600-861c-34b40812be97 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] HTTP exception thrown: Instance df8098ad-7c9c-4ba5-992d-392f9cd1742a could not be found. Aug 27 04:36:06.547929 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-e321992c-8bab-4600-861c-34b40812be97 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Returning 404 to user: Instance df8098ad-7c9c-4ba5-992d-392f9cd1742a could not be found. {{(pid=108970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:36:06.548749 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-e321992c-8bab-4600-861c-34b40812be97 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a" status: 404 len: 111 microversion: 2.1 time: 0.026021 Aug 27 04:36:06.549256 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 351/705] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:36:06 2021] GET /compute/v2.1/servers/df8098ad-7c9c-4ba5-992d-392f9cd1742a => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:36:06.556902 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-c3966517-c9d0-4530-a711-074c8bd6b0e4 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:06.557397 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-c3966517-c9d0-4530-a711-074c8bd6b0e4 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:36:06.563634 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c3966517-c9d0-4530-a711-074c8bd6b0e4 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:06.564107 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c3966517-c9d0-4530-a711-074c8bd6b0e4 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:06.564873 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c3966517-c9d0-4530-a711-074c8bd6b0e4 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:06.565308 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c3966517-c9d0-4530-a711-074c8bd6b0e4 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:06.589336 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-c3966517-c9d0-4530-a711-074c8bd6b0e4 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Going to try to terminate instance {{(pid=108971) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 04:36:06.668884 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-c3966517-c9d0-4530-a711-074c8bd6b0e4 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "DELETE /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 204 len: 0 microversion: 2.1 time: 0.115375 Aug 27 04:36:06.669456 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 355/706] 10.222.0.53 () {58 vars in 1239 bytes} [Fri Aug 27 04:36:06 2021] DELETE /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:36:06.677789 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-a1651e7a-f8ee-433c-87a4-3d2f4c014d7b tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:06.678394 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-a1651e7a-f8ee-433c-87a4-3d2f4c014d7b tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:36:06.684218 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a1651e7a-f8ee-433c-87a4-3d2f4c014d7b tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:06.684673 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a1651e7a-f8ee-433c-87a4-3d2f4c014d7b tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:06.685446 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a1651e7a-f8ee-433c-87a4-3d2f4c014d7b tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:06.685887 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a1651e7a-f8ee-433c-87a4-3d2f4c014d7b tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:06.802387 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-a1651e7a-f8ee-433c-87a4-3d2f4c014d7b tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:06.809687 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-a1651e7a-f8ee-433c-87a4-3d2f4c014d7b tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1521 microversion: 2.1 time: 0.135480 Aug 27 04:36:06.810247 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 352/707] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:36:06 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1521 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:07.061460 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-6d5442b5-f171-42da-987a-6e5859c4555c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:07.062167 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-6d5442b5-f171-42da-987a-6e5859c4555c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:36:07.067916 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6d5442b5-f171-42da-987a-6e5859c4555c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:07.068391 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6d5442b5-f171-42da-987a-6e5859c4555c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:07.069154 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6d5442b5-f171-42da-987a-6e5859c4555c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:07.069589 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6d5442b5-f171-42da-987a-6e5859c4555c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:07.189358 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-6d5442b5-f171-42da-987a-6e5859c4555c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:07.197808 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-6d5442b5-f171-42da-987a-6e5859c4555c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:07.199336 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-6d5442b5-f171-42da-987a-6e5859c4555c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:07.200499 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-6d5442b5-f171-42da-987a-6e5859c4555c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1809 microversion: 2.20 time: 0.239289 Aug 27 04:36:07.201057 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 356/708] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:36:06 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1809 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:36:07.360821 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-db6fc6dd-ce91-404d-ae65-25a317af2d06 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:07.361362 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-db6fc6dd-ce91-404d-ae65-25a317af2d06 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:36:07.367937 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-db6fc6dd-ce91-404d-ae65-25a317af2d06 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:07.368238 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-db6fc6dd-ce91-404d-ae65-25a317af2d06 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:07.369011 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-db6fc6dd-ce91-404d-ae65-25a317af2d06 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:07.369448 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-db6fc6dd-ce91-404d-ae65-25a317af2d06 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:07.490049 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-db6fc6dd-ce91-404d-ae65-25a317af2d06 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:07.497187 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-db6fc6dd-ce91-404d-ae65-25a317af2d06 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1259 microversion: 2.1 time: 0.140109 Aug 27 04:36:07.497741 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 353/709] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:36:07 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1259 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:07.825725 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-74fb1b6d-a125-4363-93ce-4a43095714a5 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:07.826335 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-74fb1b6d-a125-4363-93ce-4a43095714a5 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:36:07.832798 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-74fb1b6d-a125-4363-93ce-4a43095714a5 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:07.833240 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-74fb1b6d-a125-4363-93ce-4a43095714a5 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:07.833999 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-74fb1b6d-a125-4363-93ce-4a43095714a5 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:07.834432 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-74fb1b6d-a125-4363-93ce-4a43095714a5 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:07.953927 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-74fb1b6d-a125-4363-93ce-4a43095714a5 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:07.961072 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-74fb1b6d-a125-4363-93ce-4a43095714a5 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1521 microversion: 2.1 time: 0.138871 Aug 27 04:36:07.961623 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 357/710] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:36:07 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1521 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:08.218724 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-db7eff1f-aae5-4772-91fa-0fef0a0d2e26 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:08.219270 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-db7eff1f-aae5-4772-91fa-0fef0a0d2e26 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:36:08.225121 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-db7eff1f-aae5-4772-91fa-0fef0a0d2e26 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:08.225561 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-db7eff1f-aae5-4772-91fa-0fef0a0d2e26 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:08.226315 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-db7eff1f-aae5-4772-91fa-0fef0a0d2e26 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:08.226752 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-db7eff1f-aae5-4772-91fa-0fef0a0d2e26 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:08.345091 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-db7eff1f-aae5-4772-91fa-0fef0a0d2e26 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:08.353224 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-db7eff1f-aae5-4772-91fa-0fef0a0d2e26 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:08.354711 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-db7eff1f-aae5-4772-91fa-0fef0a0d2e26 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:08.355834 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-db7eff1f-aae5-4772-91fa-0fef0a0d2e26 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1809 microversion: 2.20 time: 0.140850 Aug 27 04:36:08.356415 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 354/711] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:36:08 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1809 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:36:08.513833 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-cdeb5afe-dac9-4d17-9703-164f236deb0e tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:08.514543 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-cdeb5afe-dac9-4d17-9703-164f236deb0e tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:36:08.520277 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cdeb5afe-dac9-4d17-9703-164f236deb0e tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:08.520722 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cdeb5afe-dac9-4d17-9703-164f236deb0e tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:08.521484 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cdeb5afe-dac9-4d17-9703-164f236deb0e tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:08.521917 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cdeb5afe-dac9-4d17-9703-164f236deb0e tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:08.646116 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-cdeb5afe-dac9-4d17-9703-164f236deb0e tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:08.653944 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-cdeb5afe-dac9-4d17-9703-164f236deb0e tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1259 microversion: 2.1 time: 0.143569 Aug 27 04:36:08.654342 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 358/712] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:36:08 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1259 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:08.978442 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-c227a2a3-ca40-4a48-8d58-c648b9da7d7d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:08.979047 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-c227a2a3-ca40-4a48-8d58-c648b9da7d7d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:36:08.985054 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-c227a2a3-ca40-4a48-8d58-c648b9da7d7d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:08.985476 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-c227a2a3-ca40-4a48-8d58-c648b9da7d7d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:08.986235 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-c227a2a3-ca40-4a48-8d58-c648b9da7d7d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:08.986664 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-c227a2a3-ca40-4a48-8d58-c648b9da7d7d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:09.105478 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-c227a2a3-ca40-4a48-8d58-c648b9da7d7d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:09.113799 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-c227a2a3-ca40-4a48-8d58-c648b9da7d7d tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1521 microversion: 2.1 time: 0.138712 Aug 27 04:36:09.114784 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 355/713] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:36:08 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1521 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:09.329248 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [req-678def24-dfb8-4e49-b965-d46dbba99604 req-a1d1cb88-b521-4d91-a0d5-ce03daae57ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2051c4e-353b-4875-8217-513125bcaf66", "name": "network-vif-plugged", "status": "completed", "tag": "236b6127-484d-477e-b8eb-9cc2f556a39e"}]} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:36:09.330857 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:36:09.330857 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: warnings.warn(msg) Aug 27 04:36:09.338089 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-678def24-dfb8-4e49-b965-d46dbba99604 req-a1d1cb88-b521-4d91-a0d5-ce03daae57ed service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:09.338611 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-678def24-dfb8-4e49-b965-d46dbba99604 req-a1d1cb88-b521-4d91-a0d5-ce03daae57ed service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:09.349703 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.compute.server_external_events [req-678def24-dfb8-4e49-b965-d46dbba99604 req-a1d1cb88-b521-4d91-a0d5-ce03daae57ed service nova] Creating event network-vif-plugged:236b6127-484d-477e-b8eb-9cc2f556a39e for instance e2051c4e-353b-4875-8217-513125bcaf66 on hv-cinder-80403 Aug 27 04:36:09.354650 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [req-678def24-dfb8-4e49-b965-d46dbba99604 req-a1d1cb88-b521-4d91-a0d5-ce03daae57ed service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028988 Aug 27 04:36:09.355237 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 359/714] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:36:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:36:09.374479 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-59f23c60-1b94-4afc-b68e-356f36238aa1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:09.375765 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-59f23c60-1b94-4afc-b68e-356f36238aa1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:36:09.381650 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-59f23c60-1b94-4afc-b68e-356f36238aa1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:09.382175 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-59f23c60-1b94-4afc-b68e-356f36238aa1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:09.383022 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-59f23c60-1b94-4afc-b68e-356f36238aa1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:09.383535 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-59f23c60-1b94-4afc-b68e-356f36238aa1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:09.508425 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-59f23c60-1b94-4afc-b68e-356f36238aa1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:09.516639 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-59f23c60-1b94-4afc-b68e-356f36238aa1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:09.518146 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-59f23c60-1b94-4afc-b68e-356f36238aa1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:09.519293 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-59f23c60-1b94-4afc-b68e-356f36238aa1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1796 microversion: 2.20 time: 0.148521 Aug 27 04:36:09.519846 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 356/715] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:36:09 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1796 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:36:09.671198 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-aca293ad-91ea-4146-a18d-04b9e67ec23a tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:09.671811 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-aca293ad-91ea-4146-a18d-04b9e67ec23a tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:36:09.678450 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-aca293ad-91ea-4146-a18d-04b9e67ec23a tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:09.678898 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-aca293ad-91ea-4146-a18d-04b9e67ec23a tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:09.679664 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-aca293ad-91ea-4146-a18d-04b9e67ec23a tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:09.680129 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-aca293ad-91ea-4146-a18d-04b9e67ec23a tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:09.815470 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-aca293ad-91ea-4146-a18d-04b9e67ec23a tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:09.822750 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-aca293ad-91ea-4146-a18d-04b9e67ec23a tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1259 microversion: 2.1 time: 0.155827 Aug 27 04:36:09.823311 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 360/716] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:36:09 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:10.130790 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-4d0623ab-9800-423f-8af0-5e54ea381626 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:10.131401 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-4d0623ab-9800-423f-8af0-5e54ea381626 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:36:10.137257 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4d0623ab-9800-423f-8af0-5e54ea381626 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:10.137706 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4d0623ab-9800-423f-8af0-5e54ea381626 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:10.138471 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4d0623ab-9800-423f-8af0-5e54ea381626 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:10.138912 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4d0623ab-9800-423f-8af0-5e54ea381626 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:10.256666 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-4d0623ab-9800-423f-8af0-5e54ea381626 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:10.264008 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-4d0623ab-9800-423f-8af0-5e54ea381626 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1521 microversion: 2.1 time: 0.136848 Aug 27 04:36:10.264613 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 357/717] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:36:10 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1521 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:10.838728 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-3e7205ed-e1a7-468c-9b5e-3fe7bfa3d7dd tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:10.839357 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-3e7205ed-e1a7-468c-9b5e-3fe7bfa3d7dd tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:36:10.845357 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3e7205ed-e1a7-468c-9b5e-3fe7bfa3d7dd tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:10.845792 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3e7205ed-e1a7-468c-9b5e-3fe7bfa3d7dd tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:10.846537 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3e7205ed-e1a7-468c-9b5e-3fe7bfa3d7dd tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:10.846963 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3e7205ed-e1a7-468c-9b5e-3fe7bfa3d7dd tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:10.964384 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-3e7205ed-e1a7-468c-9b5e-3fe7bfa3d7dd tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:10.973540 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-3e7205ed-e1a7-468c-9b5e-3fe7bfa3d7dd tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1259 microversion: 2.1 time: 0.138435 Aug 27 04:36:10.974112 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 361/718] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:36:10 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1259 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:11.282567 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-7a49b3c4-f6db-456f-97d9-114950716be8 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:11.283173 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-7a49b3c4-f6db-456f-97d9-114950716be8 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:36:11.289015 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7a49b3c4-f6db-456f-97d9-114950716be8 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:11.289460 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7a49b3c4-f6db-456f-97d9-114950716be8 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:11.290225 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7a49b3c4-f6db-456f-97d9-114950716be8 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:11.290661 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7a49b3c4-f6db-456f-97d9-114950716be8 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:11.409375 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-7a49b3c4-f6db-456f-97d9-114950716be8 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:11.416630 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-7a49b3c4-f6db-456f-97d9-114950716be8 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1521 microversion: 2.1 time: 0.138243 Aug 27 04:36:11.417189 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 358/719] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:36:11 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1521 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:11.990083 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-31f7db66-61d5-4ad3-afda-88b348c0497f tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:11.990687 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-31f7db66-61d5-4ad3-afda-88b348c0497f tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:36:11.996734 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-31f7db66-61d5-4ad3-afda-88b348c0497f tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:11.997179 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-31f7db66-61d5-4ad3-afda-88b348c0497f tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:11.997941 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-31f7db66-61d5-4ad3-afda-88b348c0497f tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:11.998376 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-31f7db66-61d5-4ad3-afda-88b348c0497f tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:12.117170 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-31f7db66-61d5-4ad3-afda-88b348c0497f tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:12.126050 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-31f7db66-61d5-4ad3-afda-88b348c0497f tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1443 microversion: 2.1 time: 0.139861 Aug 27 04:36:12.126625 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 362/720] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:36:11 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1443 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:12.142219 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-28927320-b756-4a14-a71f-a46c3b5c59a3 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:12.142858 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-28927320-b756-4a14-a71f-a46c3b5c59a3 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:36:12.148877 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-28927320-b756-4a14-a71f-a46c3b5c59a3 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:12.149324 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-28927320-b756-4a14-a71f-a46c3b5c59a3 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:12.150087 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-28927320-b756-4a14-a71f-a46c3b5c59a3 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:12.150524 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-28927320-b756-4a14-a71f-a46c3b5c59a3 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:12.269423 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-28927320-b756-4a14-a71f-a46c3b5c59a3 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:12.276628 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-28927320-b756-4a14-a71f-a46c3b5c59a3 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1443 microversion: 2.1 time: 0.138149 Aug 27 04:36:12.277189 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 359/721] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:36:12 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1443 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:12.433934 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-870d81e9-4631-479b-bfe8-b83bb3358426 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:12.434543 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-870d81e9-4631-479b-bfe8-b83bb3358426 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:36:12.440977 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-870d81e9-4631-479b-bfe8-b83bb3358426 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:12.441422 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-870d81e9-4631-479b-bfe8-b83bb3358426 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:12.442191 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-870d81e9-4631-479b-bfe8-b83bb3358426 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:12.442625 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-870d81e9-4631-479b-bfe8-b83bb3358426 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:12.566024 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-870d81e9-4631-479b-bfe8-b83bb3358426 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:12.573685 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-870d81e9-4631-479b-bfe8-b83bb3358426 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1521 microversion: 2.1 time: 0.143770 Aug 27 04:36:12.574245 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 363/722] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:36:12 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:13.590314 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-5d8e28ad-c98b-4bde-829d-9591d5f00a66 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:13.590930 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-5d8e28ad-c98b-4bde-829d-9591d5f00a66 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:36:13.596862 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5d8e28ad-c98b-4bde-829d-9591d5f00a66 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:13.597310 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5d8e28ad-c98b-4bde-829d-9591d5f00a66 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:13.598089 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5d8e28ad-c98b-4bde-829d-9591d5f00a66 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:13.598529 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5d8e28ad-c98b-4bde-829d-9591d5f00a66 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:14.040720 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-5d8e28ad-c98b-4bde-829d-9591d5f00a66 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:14.048654 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-5d8e28ad-c98b-4bde-829d-9591d5f00a66 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1521 microversion: 2.1 time: 0.461725 Aug 27 04:36:14.049157 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 360/723] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:36:13 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1521 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:14.160469 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [req-bd8ea08d-e130-4b55-93dd-7b6cbcee1316 req-b5a3fc91-6602-47e9-a3f9-8df030e797e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2051c4e-353b-4875-8217-513125bcaf66", "tag": "236b6127-484d-477e-b8eb-9cc2f556a39e"}]} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:36:14.162426 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:36:14.162426 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: warnings.warn(msg) Aug 27 04:36:14.168779 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-bd8ea08d-e130-4b55-93dd-7b6cbcee1316 req-b5a3fc91-6602-47e9-a3f9-8df030e797e2 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:14.169220 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-bd8ea08d-e130-4b55-93dd-7b6cbcee1316 req-b5a3fc91-6602-47e9-a3f9-8df030e797e2 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:14.180506 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.compute.server_external_events [req-bd8ea08d-e130-4b55-93dd-7b6cbcee1316 req-b5a3fc91-6602-47e9-a3f9-8df030e797e2 service nova] Creating event network-changed:236b6127-484d-477e-b8eb-9cc2f556a39e for instance e2051c4e-353b-4875-8217-513125bcaf66 on hv-cinder-80403 Aug 27 04:36:14.185308 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [req-bd8ea08d-e130-4b55-93dd-7b6cbcee1316 req-b5a3fc91-6602-47e9-a3f9-8df030e797e2 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029341 Aug 27 04:36:14.186029 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 364/724] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:36:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:36:15.065667 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-02fa7c48-3d9c-4311-ada4-3e95fad8a9dd tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:15.066515 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-02fa7c48-3d9c-4311-ada4-3e95fad8a9dd tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:36:15.072276 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-02fa7c48-3d9c-4311-ada4-3e95fad8a9dd tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:15.072833 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-02fa7c48-3d9c-4311-ada4-3e95fad8a9dd tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:15.073680 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-02fa7c48-3d9c-4311-ada4-3e95fad8a9dd tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:15.074187 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-02fa7c48-3d9c-4311-ada4-3e95fad8a9dd tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:15.200565 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-02fa7c48-3d9c-4311-ada4-3e95fad8a9dd tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:15.208033 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-02fa7c48-3d9c-4311-ada4-3e95fad8a9dd tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1521 microversion: 2.1 time: 0.146568 Aug 27 04:36:15.208649 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 361/725] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:36:15 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:15.911639 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [req-fb03b44e-f872-41b5-86f5-897bd0fc6ae0 req-c051ee4a-5f92-4f5c-8da4-1c7f0d070e34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e594817-f3cc-40e6-babe-c736641fb9a9", "name": "network-vif-deleted", "tag": "8d848bd3-1806-43f5-a0cc-2ccc980f7264"}]} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:36:15.914105 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:36:15.914105 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: warnings.warn(msg) Aug 27 04:36:15.919956 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-fb03b44e-f872-41b5-86f5-897bd0fc6ae0 req-c051ee4a-5f92-4f5c-8da4-1c7f0d070e34 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:15.920428 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-fb03b44e-f872-41b5-86f5-897bd0fc6ae0 req-c051ee4a-5f92-4f5c-8da4-1c7f0d070e34 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:15.930835 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.compute.server_external_events [req-fb03b44e-f872-41b5-86f5-897bd0fc6ae0 req-c051ee4a-5f92-4f5c-8da4-1c7f0d070e34 service nova] Creating event network-vif-deleted:8d848bd3-1806-43f5-a0cc-2ccc980f7264 for instance 0e594817-f3cc-40e6-babe-c736641fb9a9 on hv-cinder-80403 Aug 27 04:36:15.935503 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [req-fb03b44e-f872-41b5-86f5-897bd0fc6ae0 req-c051ee4a-5f92-4f5c-8da4-1c7f0d070e34 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027925 Aug 27 04:36:15.936228 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 365/726] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:36:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:36:16.225096 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-9d4dcddb-64cb-4dfb-aed0-36244ae79498 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:16.225696 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-9d4dcddb-64cb-4dfb-aed0-36244ae79498 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:36:16.231483 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9d4dcddb-64cb-4dfb-aed0-36244ae79498 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:16.231926 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9d4dcddb-64cb-4dfb-aed0-36244ae79498 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:16.232769 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9d4dcddb-64cb-4dfb-aed0-36244ae79498 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:16.233198 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9d4dcddb-64cb-4dfb-aed0-36244ae79498 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:16.262964 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9d4dcddb-64cb-4dfb-aed0-36244ae79498 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:16.263412 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9d4dcddb-64cb-4dfb-aed0-36244ae79498 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:16.263850 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.objects.instance [None req-9d4dcddb-64cb-4dfb-aed0-36244ae79498 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lazy-loading 'fault' on Instance uuid 0e594817-f3cc-40e6-babe-c736641fb9a9 {{(pid=108970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:36:16.302457 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-9d4dcddb-64cb-4dfb-aed0-36244ae79498 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be4f55d0a3b342f09c5881c88f4eb90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079f423a2eb4541878e236b831b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:36:16.309516 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-9d4dcddb-64cb-4dfb-aed0-36244ae79498 tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 200 len: 1311 microversion: 2.1 time: 0.088139 Aug 27 04:36:16.310080 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 362/727] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:36:16 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 1311 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:36:17.326159 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-bc2ae82b-5315-4583-9608-ab88f7be77ad tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:36:17.326853 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-bc2ae82b-5315-4583-9608-ab88f7be77ad tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] [instance: 0e594817-f3cc-40e6-babe-c736641fb9a9] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:36:17.333642 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-bc2ae82b-5315-4583-9608-ab88f7be77ad tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:17.334032 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-bc2ae82b-5315-4583-9608-ab88f7be77ad tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:17.334791 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-bc2ae82b-5315-4583-9608-ab88f7be77ad tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:36:17.335226 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-bc2ae82b-5315-4583-9608-ab88f7be77ad tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:36:17.347826 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.wsgi [None req-bc2ae82b-5315-4583-9608-ab88f7be77ad tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] HTTP exception thrown: Instance 0e594817-f3cc-40e6-babe-c736641fb9a9 could not be found. Aug 27 04:36:17.348427 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-bc2ae82b-5315-4583-9608-ab88f7be77ad tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] Returning 404 to user: Instance 0e594817-f3cc-40e6-babe-c736641fb9a9 could not be found. {{(pid=108971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:36:17.349233 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-bc2ae82b-5315-4583-9608-ab88f7be77ad tempest-ServerRescueNegativeTestJSON-1379089392 tempest-ServerRescueNegativeTestJSON-1379089392-project] 10.222.0.53 "GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9" status: 404 len: 111 microversion: 2.1 time: 0.027136 Aug 27 04:36:17.349757 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 366/728] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:36:17 2021] GET /compute/v2.1/servers/0e594817-f3cc-40e6-babe-c736641fb9a9 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:37:17.263489 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dae29848-fd8d-49a8-9138-77fd52175e15] AMQP server on 10.222.0.53:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:37:17.267228 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-52717865-1cf0-4740-a2f9-a6b0f723bde6 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-120341670", "imageRef": "9356e2fa-e55b-41d9-9ca4-53393f2d79fd", "flavorRef": "452", "networks": [{"uuid": "2c4a6e7e-9097-4463-a2f9-98b692a514cf"}]}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:17.324950 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.network.neutron [None req-52717865-1cf0-4740-a2f9-a6b0f723bde6 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] validate_networks() for [('2c4a6e7e-9097-4463-a2f9-98b692a514cf', None, None, None, None, None)] {{(pid=108970) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 04:37:17.443359 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-049ab86e-2512-4d2c-97a1-65e56949ea4d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:17.443846 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-049ab86e-2512-4d2c-97a1-65e56949ea4d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:37:17.449730 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-049ab86e-2512-4d2c-97a1-65e56949ea4d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:17.450174 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-049ab86e-2512-4d2c-97a1-65e56949ea4d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:17.450938 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-049ab86e-2512-4d2c-97a1-65e56949ea4d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:17.451369 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-049ab86e-2512-4d2c-97a1-65e56949ea4d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:17.536986 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.objects.instance [None req-049ab86e-2512-4d2c-97a1-65e56949ea4d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lazy-loading 'services' on Instance uuid 5598e9e1-bc44-4831-be1a-f478deba899b {{(pid=108971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:37:17.646162 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-049ab86e-2512-4d2c-97a1-65e56949ea4d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "DELETE /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/os-volume_attachments/d6470fe4-57a6-4f9b-9798-61b3172d3f0f" status: 202 len: 0 microversion: 2.1 time: 0.368547 Aug 27 04:37:17.646864 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 367/729] 10.222.0.53 () {58 vars in 1416 bytes} [Fri Aug 27 04:37:17 2021] DELETE /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/os-volume_attachments/d6470fe4-57a6-4f9b-9798-61b3172d3f0f => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:37:17.729843 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.virt.hardware [None req-52717865-1cf0-4740-a2f9-a6b0f723bde6 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Flavor limits 0:0:0 {{(pid=108970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:37:17.730344 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.virt.hardware [None req-52717865-1cf0-4740-a2f9-a6b0f723bde6 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Image limits 0:0:0 {{(pid=108970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:37:17.730888 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.virt.hardware [None req-52717865-1cf0-4740-a2f9-a6b0f723bde6 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Flavor pref 0:0:0 {{(pid=108970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:37:17.731387 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.virt.hardware [None req-52717865-1cf0-4740-a2f9-a6b0f723bde6 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Image pref 0:0:0 {{(pid=108970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:37:17.731873 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.virt.hardware [None req-52717865-1cf0-4740-a2f9-a6b0f723bde6 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:37:17.741481 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-52717865-1cf0-4740-a2f9-a6b0f723bde6 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:17.742004 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-52717865-1cf0-4740-a2f9-a6b0f723bde6 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:17.742881 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-52717865-1cf0-4740-a2f9-a6b0f723bde6 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:17.743391 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-52717865-1cf0-4740-a2f9-a6b0f723bde6 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:17.760599 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.quota [None req-52717865-1cf0-4740-a2f9-a6b0f723bde6 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Getting quotas for project ecbf39b95058423f95015e37925d1a8d. Resources: {'ram', 'cores', 'instances'} {{(pid=108970) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:37:17.765177 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.quota [None req-52717865-1cf0-4740-a2f9-a6b0f723bde6 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Getting quotas for user 175c169d2bfb4f0f89e2fdfe8485c999 and project ecbf39b95058423f95015e37925d1a8d. Resources: {'ram', 'cores', 'instances'} {{(pid=108970) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:37:17.775887 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-52717865-1cf0-4740-a2f9-a6b0f723bde6 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Going to run 1 instances... {{(pid=108970) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 04:37:17.778212 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-52717865-1cf0-4740-a2f9-a6b0f723bde6 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] [instance: a6d0e701-d87a-47cf-8d1a-a4244db04fe9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9356e2fa-e55b-41d9-9ca4-53393f2d79fd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 04:37:17.821849 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-52717865-1cf0-4740-a2f9-a6b0f723bde6 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] 10.222.0.53 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.559638 Aug 27 04:37:17.822487 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 363/730] 10.222.0.53 () {60 vars in 1147 bytes} [Fri Aug 27 04:37:17 2021] POST /compute/v2.1/servers => generated 380 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:37:17.833431 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-848c8253-6085-4b62-b485-b1b0637b8b26 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:17.834127 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-848c8253-6085-4b62-b485-b1b0637b8b26 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] [instance: a6d0e701-d87a-47cf-8d1a-a4244db04fe9] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:37:17.888797 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-848c8253-6085-4b62-b485-b1b0637b8b26 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175c169d2bfb4f0f89e2fdfe8485c999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbf39b95058423f95015e37925d1a8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:17.895587 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-848c8253-6085-4b62-b485-b1b0637b8b26 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] 10.222.0.53 "GET /compute/v2.1/servers/a6d0e701-d87a-47cf-8d1a-a4244db04fe9" status: 200 len: 1218 microversion: 2.1 time: 0.066145 Aug 27 04:37:17.896367 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 368/731] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:37:17 2021] GET /compute/v2.1/servers/a6d0e701-d87a-47cf-8d1a-a4244db04fe9 => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:37:18.913852 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-afd1f6c9-dcf2-45f9-8ce0-5b6e00d65af2 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:18.915183 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-afd1f6c9-dcf2-45f9-8ce0-5b6e00d65af2 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] [instance: a6d0e701-d87a-47cf-8d1a-a4244db04fe9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:37:18.933685 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-afd1f6c9-dcf2-45f9-8ce0-5b6e00d65af2 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:18.934139 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-afd1f6c9-dcf2-45f9-8ce0-5b6e00d65af2 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:18.935072 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-afd1f6c9-dcf2-45f9-8ce0-5b6e00d65af2 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:18.935574 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-afd1f6c9-dcf2-45f9-8ce0-5b6e00d65af2 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:18.952375 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO oslo.messaging._drivers.impl_rabbit [-] [dae29848-fd8d-49a8-9138-77fd52175e15] Reconnected to AMQP server on 10.222.0.53:5672 via [amqp] client with port 42546. Aug 27 04:37:19.004906 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-afd1f6c9-dcf2-45f9-8ce0-5b6e00d65af2 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175c169d2bfb4f0f89e2fdfe8485c999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbf39b95058423f95015e37925d1a8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:19.012153 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-afd1f6c9-dcf2-45f9-8ce0-5b6e00d65af2 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] 10.222.0.53 "GET /compute/v2.1/servers/a6d0e701-d87a-47cf-8d1a-a4244db04fe9" status: 200 len: 1270 microversion: 2.1 time: 0.102149 Aug 27 04:37:19.012716 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 364/732] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:37:18 2021] GET /compute/v2.1/servers/a6d0e701-d87a-47cf-8d1a-a4244db04fe9 => generated 1270 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:19.830947 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-49b544e4-db54-4903-a9da-d6382d740106 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:19.837363 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-49b544e4-db54-4903-a9da-d6382d740106 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:19.837805 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-49b544e4-db54-4903-a9da-d6382d740106 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:19.900847 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-49b544e4-db54-4903-a9da-d6382d740106 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Going to try to stop instance {{(pid=108971) force_stop /opt/stack/nova/nova/compute/api.py:2615}} Aug 27 04:37:19.944214 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-49b544e4-db54-4903-a9da-d6382d740106 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 202 len: 0 microversion: 2.1 time: 0.118113 Aug 27 04:37:19.945021 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 369/733] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:37:19 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:37:19.953815 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-41d63da3-e7d0-4c99-b463-9207d318eeea tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:19.954430 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-41d63da3-e7d0-4c99-b463-9207d318eeea tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:37:19.960503 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-41d63da3-e7d0-4c99-b463-9207d318eeea tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:19.961243 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-41d63da3-e7d0-4c99-b463-9207d318eeea tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:19.962019 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-41d63da3-e7d0-4c99-b463-9207d318eeea tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:19.962454 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-41d63da3-e7d0-4c99-b463-9207d318eeea tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:20.030939 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-b3a5cc56-c9a0-4a3e-9652-10e264fc4481 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:20.031707 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-b3a5cc56-c9a0-4a3e-9652-10e264fc4481 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] [instance: a6d0e701-d87a-47cf-8d1a-a4244db04fe9] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:37:20.037797 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b3a5cc56-c9a0-4a3e-9652-10e264fc4481 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:20.038245 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b3a5cc56-c9a0-4a3e-9652-10e264fc4481 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:20.039046 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b3a5cc56-c9a0-4a3e-9652-10e264fc4481 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:20.039646 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b3a5cc56-c9a0-4a3e-9652-10e264fc4481 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:20.096500 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-41d63da3-e7d0-4c99-b463-9207d318eeea tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:20.103904 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-41d63da3-e7d0-4c99-b463-9207d318eeea tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1678 microversion: 2.1 time: 0.154876 Aug 27 04:37:20.104519 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 365/734] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:37:19 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:20.257464 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-b3a5cc56-c9a0-4a3e-9652-10e264fc4481 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175c169d2bfb4f0f89e2fdfe8485c999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbf39b95058423f95015e37925d1a8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:20.264652 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-b3a5cc56-c9a0-4a3e-9652-10e264fc4481 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] 10.222.0.53 "GET /compute/v2.1/servers/a6d0e701-d87a-47cf-8d1a-a4244db04fe9" status: 200 len: 1318 microversion: 2.1 time: 0.238872 Aug 27 04:37:20.265339 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 370/735] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:37:20 2021] GET /compute/v2.1/servers/a6d0e701-d87a-47cf-8d1a-a4244db04fe9 => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:37:20.447166 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [req-493c0336-3b14-40bb-9b0d-a67ae932ad59 req-f19e2ac7-2c64-4612-a647-310506bbd4bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6d0e701-d87a-47cf-8d1a-a4244db04fe9", "tag": "4d991ffc-660b-476d-9195-4a393686c29d"}]} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:20.448753 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:37:20.448753 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: warnings.warn(msg) Aug 27 04:37:20.455404 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-493c0336-3b14-40bb-9b0d-a67ae932ad59 req-f19e2ac7-2c64-4612-a647-310506bbd4bb service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:20.455842 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-493c0336-3b14-40bb-9b0d-a67ae932ad59 req-f19e2ac7-2c64-4612-a647-310506bbd4bb service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:20.466222 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.compute.server_external_events [req-493c0336-3b14-40bb-9b0d-a67ae932ad59 req-f19e2ac7-2c64-4612-a647-310506bbd4bb service nova] Creating event network-changed:4d991ffc-660b-476d-9195-4a393686c29d for instance a6d0e701-d87a-47cf-8d1a-a4244db04fe9 on hv-cinder-80403 Aug 27 04:37:20.471776 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [req-493c0336-3b14-40bb-9b0d-a67ae932ad59 req-f19e2ac7-2c64-4612-a647-310506bbd4bb service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087673 Aug 27 04:37:20.472392 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 366/736] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:37:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:37:21.121926 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-e7d8c188-d325-4d11-825f-ca069eaddb89 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:21.123151 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-e7d8c188-d325-4d11-825f-ca069eaddb89 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:37:21.129383 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e7d8c188-d325-4d11-825f-ca069eaddb89 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:21.129982 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e7d8c188-d325-4d11-825f-ca069eaddb89 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:21.130751 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e7d8c188-d325-4d11-825f-ca069eaddb89 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:21.131183 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e7d8c188-d325-4d11-825f-ca069eaddb89 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:21.282677 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-9ad17818-0a6c-4913-b648-92de5f4a8eb3 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:21.283279 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-9ad17818-0a6c-4913-b648-92de5f4a8eb3 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] [instance: a6d0e701-d87a-47cf-8d1a-a4244db04fe9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:37:21.289722 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9ad17818-0a6c-4913-b648-92de5f4a8eb3 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:21.290169 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9ad17818-0a6c-4913-b648-92de5f4a8eb3 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:21.290956 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9ad17818-0a6c-4913-b648-92de5f4a8eb3 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:21.291390 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9ad17818-0a6c-4913-b648-92de5f4a8eb3 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:21.416973 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-9ad17818-0a6c-4913-b648-92de5f4a8eb3 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175c169d2bfb4f0f89e2fdfe8485c999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbf39b95058423f95015e37925d1a8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:21.424895 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-9ad17818-0a6c-4913-b648-92de5f4a8eb3 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] 10.222.0.53 "GET /compute/v2.1/servers/a6d0e701-d87a-47cf-8d1a-a4244db04fe9" status: 200 len: 1318 microversion: 2.1 time: 0.146839 Aug 27 04:37:21.425468 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 367/737] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:37:21 2021] GET /compute/v2.1/servers/a6d0e701-d87a-47cf-8d1a-a4244db04fe9 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:37:21.519248 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-e7d8c188-d325-4d11-825f-ca069eaddb89 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:21.526588 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-e7d8c188-d325-4d11-825f-ca069eaddb89 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1678 microversion: 2.1 time: 0.408257 Aug 27 04:37:21.527152 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 371/738] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:37:21 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1678 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:22.444312 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-783176d7-fd72-4c01-9f28-f89b8888ea40 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:22.444912 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-783176d7-fd72-4c01-9f28-f89b8888ea40 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] [instance: a6d0e701-d87a-47cf-8d1a-a4244db04fe9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:37:22.450921 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-783176d7-fd72-4c01-9f28-f89b8888ea40 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:22.451369 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-783176d7-fd72-4c01-9f28-f89b8888ea40 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:22.452198 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-783176d7-fd72-4c01-9f28-f89b8888ea40 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:22.452640 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-783176d7-fd72-4c01-9f28-f89b8888ea40 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:22.544210 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-041daa53-2eef-48d1-b278-fa712f8d9245 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:22.544905 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-041daa53-2eef-48d1-b278-fa712f8d9245 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:37:22.551341 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-041daa53-2eef-48d1-b278-fa712f8d9245 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:22.551878 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-041daa53-2eef-48d1-b278-fa712f8d9245 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:22.552722 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-041daa53-2eef-48d1-b278-fa712f8d9245 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:22.553218 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-041daa53-2eef-48d1-b278-fa712f8d9245 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:22.576557 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-783176d7-fd72-4c01-9f28-f89b8888ea40 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175c169d2bfb4f0f89e2fdfe8485c999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbf39b95058423f95015e37925d1a8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:22.583779 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-783176d7-fd72-4c01-9f28-f89b8888ea40 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] 10.222.0.53 "GET /compute/v2.1/servers/a6d0e701-d87a-47cf-8d1a-a4244db04fe9" status: 200 len: 1318 microversion: 2.1 time: 0.144933 Aug 27 04:37:22.584390 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 368/739] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:37:22 2021] GET /compute/v2.1/servers/a6d0e701-d87a-47cf-8d1a-a4244db04fe9 => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:22.673802 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-041daa53-2eef-48d1-b278-fa712f8d9245 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:22.681036 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-041daa53-2eef-48d1-b278-fa712f8d9245 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1678 microversion: 2.1 time: 0.140402 Aug 27 04:37:22.681600 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 372/740] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:37:22 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1678 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:37:23.599766 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-4cc9f759-6a5e-4a75-84be-11c9057421f7 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:23.600500 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-4cc9f759-6a5e-4a75-84be-11c9057421f7 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] [instance: a6d0e701-d87a-47cf-8d1a-a4244db04fe9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:37:23.606334 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4cc9f759-6a5e-4a75-84be-11c9057421f7 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:23.606784 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4cc9f759-6a5e-4a75-84be-11c9057421f7 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:23.607554 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4cc9f759-6a5e-4a75-84be-11c9057421f7 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:23.608004 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4cc9f759-6a5e-4a75-84be-11c9057421f7 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:23.700974 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-e5b93ff6-3966-4b01-b3d3-5fc903000c44 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:23.702257 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-e5b93ff6-3966-4b01-b3d3-5fc903000c44 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:37:23.712967 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e5b93ff6-3966-4b01-b3d3-5fc903000c44 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:23.713887 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e5b93ff6-3966-4b01-b3d3-5fc903000c44 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:23.715280 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e5b93ff6-3966-4b01-b3d3-5fc903000c44 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:23.716038 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e5b93ff6-3966-4b01-b3d3-5fc903000c44 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:23.743020 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-4cc9f759-6a5e-4a75-84be-11c9057421f7 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175c169d2bfb4f0f89e2fdfe8485c999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbf39b95058423f95015e37925d1a8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:23.750928 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-4cc9f759-6a5e-4a75-84be-11c9057421f7 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] 10.222.0.53 "GET /compute/v2.1/servers/a6d0e701-d87a-47cf-8d1a-a4244db04fe9" status: 200 len: 1318 microversion: 2.1 time: 0.154947 Aug 27 04:37:23.751499 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 369/741] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:37:23 2021] GET /compute/v2.1/servers/a6d0e701-d87a-47cf-8d1a-a4244db04fe9 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:23.845400 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-e5b93ff6-3966-4b01-b3d3-5fc903000c44 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:23.852745 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-e5b93ff6-3966-4b01-b3d3-5fc903000c44 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1678 microversion: 2.1 time: 0.158624 Aug 27 04:37:23.853311 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 373/742] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:37:23 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:37:24.768233 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-eda2b903-32db-451b-b78a-c9a0f9db476b tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:24.768837 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-eda2b903-32db-451b-b78a-c9a0f9db476b tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] [instance: a6d0e701-d87a-47cf-8d1a-a4244db04fe9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:37:24.774937 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-eda2b903-32db-451b-b78a-c9a0f9db476b tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:24.775420 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-eda2b903-32db-451b-b78a-c9a0f9db476b tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:24.776248 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-eda2b903-32db-451b-b78a-c9a0f9db476b tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:24.776690 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-eda2b903-32db-451b-b78a-c9a0f9db476b tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:24.879462 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-51997285-ce43-48a1-a906-cde01ade79dc tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:24.879462 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-51997285-ce43-48a1-a906-cde01ade79dc tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:37:24.879462 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-51997285-ce43-48a1-a906-cde01ade79dc tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:24.879462 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-51997285-ce43-48a1-a906-cde01ade79dc tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:24.880327 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-51997285-ce43-48a1-a906-cde01ade79dc tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:24.880327 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-51997285-ce43-48a1-a906-cde01ade79dc tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:24.909003 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-eda2b903-32db-451b-b78a-c9a0f9db476b tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175c169d2bfb4f0f89e2fdfe8485c999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbf39b95058423f95015e37925d1a8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:24.916649 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-eda2b903-32db-451b-b78a-c9a0f9db476b tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] 10.222.0.53 "GET /compute/v2.1/servers/a6d0e701-d87a-47cf-8d1a-a4244db04fe9" status: 200 len: 1318 microversion: 2.1 time: 0.152555 Aug 27 04:37:24.917323 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 370/743] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:37:24 2021] GET /compute/v2.1/servers/a6d0e701-d87a-47cf-8d1a-a4244db04fe9 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:25.000915 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-51997285-ce43-48a1-a906-cde01ade79dc tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:25.008069 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-51997285-ce43-48a1-a906-cde01ade79dc tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1678 microversion: 2.1 time: 0.140399 Aug 27 04:37:25.008633 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 374/744] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:37:24 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1678 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:37:25.933595 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-284ff0d5-a8ef-4898-bdf2-3b1221bb0585 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:25.934128 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-284ff0d5-a8ef-4898-bdf2-3b1221bb0585 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] [instance: a6d0e701-d87a-47cf-8d1a-a4244db04fe9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:37:25.940005 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-284ff0d5-a8ef-4898-bdf2-3b1221bb0585 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:25.940454 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-284ff0d5-a8ef-4898-bdf2-3b1221bb0585 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:25.941207 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-284ff0d5-a8ef-4898-bdf2-3b1221bb0585 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:25.941638 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-284ff0d5-a8ef-4898-bdf2-3b1221bb0585 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:26.025331 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-a3d3cd3d-fef1-4a2d-be8c-eb46f6c566ad tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:26.025942 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-a3d3cd3d-fef1-4a2d-be8c-eb46f6c566ad tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:37:26.032509 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a3d3cd3d-fef1-4a2d-be8c-eb46f6c566ad tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:26.032954 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a3d3cd3d-fef1-4a2d-be8c-eb46f6c566ad tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:26.033726 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a3d3cd3d-fef1-4a2d-be8c-eb46f6c566ad tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:26.034156 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a3d3cd3d-fef1-4a2d-be8c-eb46f6c566ad tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:26.062905 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-284ff0d5-a8ef-4898-bdf2-3b1221bb0585 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175c169d2bfb4f0f89e2fdfe8485c999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbf39b95058423f95015e37925d1a8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:26.070253 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-284ff0d5-a8ef-4898-bdf2-3b1221bb0585 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] 10.222.0.53 "GET /compute/v2.1/servers/a6d0e701-d87a-47cf-8d1a-a4244db04fe9" status: 200 len: 1318 microversion: 2.1 time: 0.140329 Aug 27 04:37:26.070832 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 371/745] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:37:25 2021] GET /compute/v2.1/servers/a6d0e701-d87a-47cf-8d1a-a4244db04fe9 => generated 1318 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:26.151468 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-a3d3cd3d-fef1-4a2d-be8c-eb46f6c566ad tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:26.159293 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-a3d3cd3d-fef1-4a2d-be8c-eb46f6c566ad tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1678 microversion: 2.1 time: 0.137562 Aug 27 04:37:26.159861 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 375/746] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:37:26 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1678 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:37:27.088017 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-cc30837b-6aa8-4ae8-8dfb-a120cfa1fbd1 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:27.088731 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-cc30837b-6aa8-4ae8-8dfb-a120cfa1fbd1 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] [instance: a6d0e701-d87a-47cf-8d1a-a4244db04fe9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:37:27.096079 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-cc30837b-6aa8-4ae8-8dfb-a120cfa1fbd1 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:27.096536 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-cc30837b-6aa8-4ae8-8dfb-a120cfa1fbd1 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:27.097312 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-cc30837b-6aa8-4ae8-8dfb-a120cfa1fbd1 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:27.097755 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-cc30837b-6aa8-4ae8-8dfb-a120cfa1fbd1 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:27.176748 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-7d413aa3-fa2a-4033-b3af-70316a8502ba tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:27.177362 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-7d413aa3-fa2a-4033-b3af-70316a8502ba tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:37:27.183156 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7d413aa3-fa2a-4033-b3af-70316a8502ba tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:27.183603 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7d413aa3-fa2a-4033-b3af-70316a8502ba tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:27.184397 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7d413aa3-fa2a-4033-b3af-70316a8502ba tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:27.184845 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7d413aa3-fa2a-4033-b3af-70316a8502ba tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:27.219303 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-cc30837b-6aa8-4ae8-8dfb-a120cfa1fbd1 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175c169d2bfb4f0f89e2fdfe8485c999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbf39b95058423f95015e37925d1a8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:27.227009 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-cc30837b-6aa8-4ae8-8dfb-a120cfa1fbd1 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] 10.222.0.53 "GET /compute/v2.1/servers/a6d0e701-d87a-47cf-8d1a-a4244db04fe9" status: 200 len: 1318 microversion: 2.1 time: 0.142735 Aug 27 04:37:27.227593 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 372/747] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:37:27 2021] GET /compute/v2.1/servers/a6d0e701-d87a-47cf-8d1a-a4244db04fe9 => generated 1318 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:27.309712 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-7d413aa3-fa2a-4033-b3af-70316a8502ba tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:27.317087 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-7d413aa3-fa2a-4033-b3af-70316a8502ba tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1678 microversion: 2.1 time: 0.144141 Aug 27 04:37:27.317659 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 376/748] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:37:27 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1678 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:28.245160 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-e2ab1343-7e32-40a7-9f0e-d411c557fa80 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:28.245672 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-e2ab1343-7e32-40a7-9f0e-d411c557fa80 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] [instance: a6d0e701-d87a-47cf-8d1a-a4244db04fe9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:37:28.251591 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e2ab1343-7e32-40a7-9f0e-d411c557fa80 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:28.252172 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e2ab1343-7e32-40a7-9f0e-d411c557fa80 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:28.252951 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e2ab1343-7e32-40a7-9f0e-d411c557fa80 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:28.253391 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e2ab1343-7e32-40a7-9f0e-d411c557fa80 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:28.334367 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-ec3aabfb-82a2-452a-a79a-ac96a274dd82 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:28.335121 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-ec3aabfb-82a2-452a-a79a-ac96a274dd82 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:37:28.340912 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ec3aabfb-82a2-452a-a79a-ac96a274dd82 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:28.341352 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ec3aabfb-82a2-452a-a79a-ac96a274dd82 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:28.342108 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ec3aabfb-82a2-452a-a79a-ac96a274dd82 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:28.342536 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ec3aabfb-82a2-452a-a79a-ac96a274dd82 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:28.376291 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-e2ab1343-7e32-40a7-9f0e-d411c557fa80 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175c169d2bfb4f0f89e2fdfe8485c999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbf39b95058423f95015e37925d1a8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:28.383587 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-e2ab1343-7e32-40a7-9f0e-d411c557fa80 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] 10.222.0.53 "GET /compute/v2.1/servers/a6d0e701-d87a-47cf-8d1a-a4244db04fe9" status: 200 len: 1318 microversion: 2.1 time: 0.142224 Aug 27 04:37:28.384184 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 373/749] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:37:28 2021] GET /compute/v2.1/servers/a6d0e701-d87a-47cf-8d1a-a4244db04fe9 => generated 1318 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:28.462351 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-ec3aabfb-82a2-452a-a79a-ac96a274dd82 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:28.471974 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-ec3aabfb-82a2-452a-a79a-ac96a274dd82 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1678 microversion: 2.1 time: 0.141000 Aug 27 04:37:28.472685 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 377/750] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:37:28 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1678 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:29.401319 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-f636089b-591d-4c4c-b8d1-2d664f29dd31 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:29.401923 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-f636089b-591d-4c4c-b8d1-2d664f29dd31 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] [instance: a6d0e701-d87a-47cf-8d1a-a4244db04fe9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:37:29.407705 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f636089b-591d-4c4c-b8d1-2d664f29dd31 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:29.408185 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f636089b-591d-4c4c-b8d1-2d664f29dd31 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:29.408945 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f636089b-591d-4c4c-b8d1-2d664f29dd31 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:29.409377 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f636089b-591d-4c4c-b8d1-2d664f29dd31 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:29.489629 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-69c1b760-7005-42ec-a256-83058e647e80 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:29.490256 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-69c1b760-7005-42ec-a256-83058e647e80 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:37:29.496446 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-69c1b760-7005-42ec-a256-83058e647e80 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:29.496897 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-69c1b760-7005-42ec-a256-83058e647e80 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:29.497674 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-69c1b760-7005-42ec-a256-83058e647e80 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:29.498122 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-69c1b760-7005-42ec-a256-83058e647e80 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:29.535866 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-f636089b-591d-4c4c-b8d1-2d664f29dd31 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175c169d2bfb4f0f89e2fdfe8485c999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbf39b95058423f95015e37925d1a8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:29.543960 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-f636089b-591d-4c4c-b8d1-2d664f29dd31 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] 10.222.0.53 "GET /compute/v2.1/servers/a6d0e701-d87a-47cf-8d1a-a4244db04fe9" status: 200 len: 1318 microversion: 2.1 time: 0.146181 Aug 27 04:37:29.544810 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 374/751] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:37:29 2021] GET /compute/v2.1/servers/a6d0e701-d87a-47cf-8d1a-a4244db04fe9 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:29.630175 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-69c1b760-7005-42ec-a256-83058e647e80 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:29.637433 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-69c1b760-7005-42ec-a256-83058e647e80 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1678 microversion: 2.1 time: 0.151978 Aug 27 04:37:29.638000 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 378/752] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:37:29 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:37:29.758793 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [req-14f48353-e0cb-4765-a84b-4e261be481d2 req-a03ce0c6-2ac0-499d-8d83-14fe2003bf20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6d0e701-d87a-47cf-8d1a-a4244db04fe9", "name": "network-vif-plugged", "status": "completed", "tag": "4d991ffc-660b-476d-9195-4a393686c29d"}]} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:29.760422 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:37:29.760422 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: warnings.warn(msg) Aug 27 04:37:29.767378 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-14f48353-e0cb-4765-a84b-4e261be481d2 req-a03ce0c6-2ac0-499d-8d83-14fe2003bf20 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:29.767893 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-14f48353-e0cb-4765-a84b-4e261be481d2 req-a03ce0c6-2ac0-499d-8d83-14fe2003bf20 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:29.779272 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.compute.server_external_events [req-14f48353-e0cb-4765-a84b-4e261be481d2 req-a03ce0c6-2ac0-499d-8d83-14fe2003bf20 service nova] Creating event network-vif-plugged:4d991ffc-660b-476d-9195-4a393686c29d for instance a6d0e701-d87a-47cf-8d1a-a4244db04fe9 on hv-cinder-80403 Aug 27 04:37:29.784143 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [req-14f48353-e0cb-4765-a84b-4e261be481d2 req-a03ce0c6-2ac0-499d-8d83-14fe2003bf20 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084809 Aug 27 04:37:29.784725 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 375/753] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:37:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:37:30.561306 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-477325a1-b717-48ee-bb22-bc34c4bb8c52 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:30.561915 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-477325a1-b717-48ee-bb22-bc34c4bb8c52 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] [instance: a6d0e701-d87a-47cf-8d1a-a4244db04fe9] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:37:30.568079 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-477325a1-b717-48ee-bb22-bc34c4bb8c52 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:30.568462 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-477325a1-b717-48ee-bb22-bc34c4bb8c52 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:30.569256 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-477325a1-b717-48ee-bb22-bc34c4bb8c52 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:30.569689 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-477325a1-b717-48ee-bb22-bc34c4bb8c52 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:30.654905 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-b0556126-1f51-4157-ac05-24e05c716c33 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:30.655615 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-b0556126-1f51-4157-ac05-24e05c716c33 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:37:30.662436 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b0556126-1f51-4157-ac05-24e05c716c33 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:30.662889 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b0556126-1f51-4157-ac05-24e05c716c33 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:30.663666 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b0556126-1f51-4157-ac05-24e05c716c33 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:30.664145 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b0556126-1f51-4157-ac05-24e05c716c33 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:30.689722 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-477325a1-b717-48ee-bb22-bc34c4bb8c52 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175c169d2bfb4f0f89e2fdfe8485c999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbf39b95058423f95015e37925d1a8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:30.697416 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-477325a1-b717-48ee-bb22-bc34c4bb8c52 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] 10.222.0.53 "GET /compute/v2.1/servers/a6d0e701-d87a-47cf-8d1a-a4244db04fe9" status: 200 len: 1318 microversion: 2.1 time: 0.139706 Aug 27 04:37:30.697983 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 379/754] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:37:30 2021] GET /compute/v2.1/servers/a6d0e701-d87a-47cf-8d1a-a4244db04fe9 => generated 1318 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:30.784859 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-b0556126-1f51-4157-ac05-24e05c716c33 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:30.792071 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-b0556126-1f51-4157-ac05-24e05c716c33 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1678 microversion: 2.1 time: 0.141108 Aug 27 04:37:30.792637 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 376/755] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:37:30 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1678 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:37:31.714726 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-172614eb-62aa-4f91-b524-cca9e950996a tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:31.715289 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-172614eb-62aa-4f91-b524-cca9e950996a tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] [instance: a6d0e701-d87a-47cf-8d1a-a4244db04fe9] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:37:31.721288 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-172614eb-62aa-4f91-b524-cca9e950996a tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:31.721735 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-172614eb-62aa-4f91-b524-cca9e950996a tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:31.722988 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-172614eb-62aa-4f91-b524-cca9e950996a tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:31.723426 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-172614eb-62aa-4f91-b524-cca9e950996a tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:31.809483 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-b5985c98-7f74-449e-b2da-74065069acc9 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:31.810412 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-b5985c98-7f74-449e-b2da-74065069acc9 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:37:31.818322 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b5985c98-7f74-449e-b2da-74065069acc9 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:31.818826 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b5985c98-7f74-449e-b2da-74065069acc9 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:31.819609 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b5985c98-7f74-449e-b2da-74065069acc9 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:31.820077 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b5985c98-7f74-449e-b2da-74065069acc9 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:31.848629 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-172614eb-62aa-4f91-b524-cca9e950996a tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175c169d2bfb4f0f89e2fdfe8485c999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbf39b95058423f95015e37925d1a8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:31.856736 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-172614eb-62aa-4f91-b524-cca9e950996a tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] 10.222.0.53 "GET /compute/v2.1/servers/a6d0e701-d87a-47cf-8d1a-a4244db04fe9" status: 200 len: 1318 microversion: 2.1 time: 0.145718 Aug 27 04:37:31.857308 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 380/756] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:37:31 2021] GET /compute/v2.1/servers/a6d0e701-d87a-47cf-8d1a-a4244db04fe9 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:31.943600 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-b5985c98-7f74-449e-b2da-74065069acc9 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:31.951030 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-b5985c98-7f74-449e-b2da-74065069acc9 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1655 microversion: 2.1 time: 0.145746 Aug 27 04:37:31.951594 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 377/757] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:37:31 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1655 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:37:31.967481 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-b9d141b4-73bb-4bd7-b3be-36fc1a1ea42d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:31.973832 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b9d141b4-73bb-4bd7-b3be-36fc1a1ea42d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:31.974275 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b9d141b4-73bb-4bd7-b3be-36fc1a1ea42d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:31.995974 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-b9d141b4-73bb-4bd7-b3be-36fc1a1ea42d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Going to try to start instance {{(pid=108971) start /opt/stack/nova/nova/compute/api.py:2638}} Aug 27 04:37:32.036881 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-b9d141b4-73bb-4bd7-b3be-36fc1a1ea42d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action" status: 202 len: 0 microversion: 2.1 time: 0.072927 Aug 27 04:37:32.037498 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 381/758] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:37:31 2021] POST /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:37:32.046063 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-89128ff1-2f61-4395-8e1b-59595c796201 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:32.046724 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-89128ff1-2f61-4395-8e1b-59595c796201 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:37:32.052617 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-89128ff1-2f61-4395-8e1b-59595c796201 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:32.053078 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-89128ff1-2f61-4395-8e1b-59595c796201 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:32.053831 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-89128ff1-2f61-4395-8e1b-59595c796201 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:32.054264 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-89128ff1-2f61-4395-8e1b-59595c796201 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:32.189962 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-89128ff1-2f61-4395-8e1b-59595c796201 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:32.197907 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-89128ff1-2f61-4395-8e1b-59595c796201 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1664 microversion: 2.1 time: 0.156044 Aug 27 04:37:32.198519 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 378/759] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:37:32 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1664 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:32.876132 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-0f003093-224c-4363-8b40-fb8046bd4ccf tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:32.876779 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-0f003093-224c-4363-8b40-fb8046bd4ccf tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] [instance: a6d0e701-d87a-47cf-8d1a-a4244db04fe9] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:37:32.883412 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0f003093-224c-4363-8b40-fb8046bd4ccf tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:32.883864 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0f003093-224c-4363-8b40-fb8046bd4ccf tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:32.884655 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0f003093-224c-4363-8b40-fb8046bd4ccf tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:32.885091 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0f003093-224c-4363-8b40-fb8046bd4ccf tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:33.006588 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-0f003093-224c-4363-8b40-fb8046bd4ccf tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175c169d2bfb4f0f89e2fdfe8485c999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbf39b95058423f95015e37925d1a8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:33.013685 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-0f003093-224c-4363-8b40-fb8046bd4ccf tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] 10.222.0.53 "GET /compute/v2.1/servers/a6d0e701-d87a-47cf-8d1a-a4244db04fe9" status: 200 len: 1508 microversion: 2.1 time: 0.142243 Aug 27 04:37:33.014243 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 382/760] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:37:32 2021] GET /compute/v2.1/servers/a6d0e701-d87a-47cf-8d1a-a4244db04fe9 => generated 1508 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:33.215436 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-a2ca66d0-584b-48ef-8768-ae8f9467e0cd tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:33.216063 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-a2ca66d0-584b-48ef-8768-ae8f9467e0cd tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:37:33.221740 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a2ca66d0-584b-48ef-8768-ae8f9467e0cd tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:33.222670 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a2ca66d0-584b-48ef-8768-ae8f9467e0cd tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:33.223512 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a2ca66d0-584b-48ef-8768-ae8f9467e0cd tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:33.223945 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a2ca66d0-584b-48ef-8768-ae8f9467e0cd tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:33.346764 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-a2ca66d0-584b-48ef-8768-ae8f9467e0cd tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:33.355971 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-a2ca66d0-584b-48ef-8768-ae8f9467e0cd tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1664 microversion: 2.1 time: 0.144066 Aug 27 04:37:33.366923 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 379/761] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:37:33 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1664 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:34.374302 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-c214f2af-9851-452b-9462-341f9456b4f8 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:34.375026 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-c214f2af-9851-452b-9462-341f9456b4f8 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:37:34.381323 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c214f2af-9851-452b-9462-341f9456b4f8 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:34.381770 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c214f2af-9851-452b-9462-341f9456b4f8 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:34.382554 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c214f2af-9851-452b-9462-341f9456b4f8 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:34.382994 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c214f2af-9851-452b-9462-341f9456b4f8 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:34.514697 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-c214f2af-9851-452b-9462-341f9456b4f8 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:34.529413 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-c214f2af-9851-452b-9462-341f9456b4f8 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1668 microversion: 2.1 time: 0.159014 Aug 27 04:37:34.529915 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 383/762] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:37:34 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1668 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:40.910103 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:37:40.910669 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: Fri Aug 27 04:37:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:37:45.023577 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-800f1f87-1bda-4634-9fbb-d6e5c89fcbda tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:37:45.025377 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-800f1f87-1bda-4634-9fbb-d6e5c89fcbda tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [instance: 89e425c1-0168-4f5d-8635-dd6b9f88c580] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:37:45.035282 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-800f1f87-1bda-4634-9fbb-d6e5c89fcbda tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:45.036629 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-800f1f87-1bda-4634-9fbb-d6e5c89fcbda tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:45.037939 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-800f1f87-1bda-4634-9fbb-d6e5c89fcbda tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:45.038723 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-800f1f87-1bda-4634-9fbb-d6e5c89fcbda tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:45.138278 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-800f1f87-1bda-4634-9fbb-d6e5c89fcbda tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "POST /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580/action" status: 202 len: 0 microversion: 2.1 time: 0.121244 Aug 27 04:37:45.138914 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 380/763] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:37:45 2021] POST /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:37:45.146098 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f0f36fda-08d4-4c1a-88ce-2c1dbccccae7] AMQP server on 10.222.0.53:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:37:45.151574 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-296d610b-f081-4d71-ac3b-876596badcae tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:45.151574 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-296d610b-f081-4d71-ac3b-876596badcae tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [instance: 89e425c1-0168-4f5d-8635-dd6b9f88c580] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:37:45.156560 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-296d610b-f081-4d71-ac3b-876596badcae tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:45.157222 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-296d610b-f081-4d71-ac3b-876596badcae tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:45.158933 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-296d610b-f081-4d71-ac3b-876596badcae tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:45.160253 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-296d610b-f081-4d71-ac3b-876596badcae tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:45.310218 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-296d610b-f081-4d71-ac3b-876596badcae tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b01f24964a490da63d33097d0f9a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d957eb500948908f38f0f427a9017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:45.318153 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-296d610b-f081-4d71-ac3b-876596badcae tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580" status: 200 len: 1751 microversion: 2.1 time: 0.173714 Aug 27 04:37:45.318857 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 384/764] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:37:45 2021] GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580 => generated 1751 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:37:46.336591 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-5e6cb616-197b-4507-a2e6-4475a20344a9 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:46.337277 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-5e6cb616-197b-4507-a2e6-4475a20344a9 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [instance: 89e425c1-0168-4f5d-8635-dd6b9f88c580] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:37:46.343420 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5e6cb616-197b-4507-a2e6-4475a20344a9 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:46.343871 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5e6cb616-197b-4507-a2e6-4475a20344a9 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:46.344652 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5e6cb616-197b-4507-a2e6-4475a20344a9 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:46.345087 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5e6cb616-197b-4507-a2e6-4475a20344a9 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:46.472684 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-5e6cb616-197b-4507-a2e6-4475a20344a9 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b01f24964a490da63d33097d0f9a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d957eb500948908f38f0f427a9017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:46.480929 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-5e6cb616-197b-4507-a2e6-4475a20344a9 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580" status: 200 len: 1756 microversion: 2.1 time: 0.148526 Aug 27 04:37:46.481491 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 381/765] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:37:46 2021] GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580 => generated 1756 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:47.499204 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-c3dace6f-83af-41b1-975b-3be0ee7fd703 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:47.499828 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-c3dace6f-83af-41b1-975b-3be0ee7fd703 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [instance: 89e425c1-0168-4f5d-8635-dd6b9f88c580] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:37:47.524149 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO oslo.messaging._drivers.impl_rabbit [-] [f0f36fda-08d4-4c1a-88ce-2c1dbccccae7] Reconnected to AMQP server on 10.222.0.53:5672 via [amqp] client with port 42728. Aug 27 04:37:47.528649 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c3dace6f-83af-41b1-975b-3be0ee7fd703 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:47.529128 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c3dace6f-83af-41b1-975b-3be0ee7fd703 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:47.530158 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c3dace6f-83af-41b1-975b-3be0ee7fd703 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:47.530689 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c3dace6f-83af-41b1-975b-3be0ee7fd703 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:47.675946 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-c3dace6f-83af-41b1-975b-3be0ee7fd703 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b01f24964a490da63d33097d0f9a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d957eb500948908f38f0f427a9017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:47.684209 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-c3dace6f-83af-41b1-975b-3be0ee7fd703 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580" status: 200 len: 1756 microversion: 2.1 time: 0.189004 Aug 27 04:37:47.684786 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 385/766] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:37:47 2021] GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580 => generated 1756 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:48.701143 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-243c2f9b-5ca4-414b-8798-ca59fa5bbfa4 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:48.701775 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-243c2f9b-5ca4-414b-8798-ca59fa5bbfa4 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [instance: 89e425c1-0168-4f5d-8635-dd6b9f88c580] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:37:48.708192 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-243c2f9b-5ca4-414b-8798-ca59fa5bbfa4 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:48.708630 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-243c2f9b-5ca4-414b-8798-ca59fa5bbfa4 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:48.709395 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-243c2f9b-5ca4-414b-8798-ca59fa5bbfa4 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:48.709826 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-243c2f9b-5ca4-414b-8798-ca59fa5bbfa4 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:48.837576 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-243c2f9b-5ca4-414b-8798-ca59fa5bbfa4 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b01f24964a490da63d33097d0f9a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d957eb500948908f38f0f427a9017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:48.845420 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-243c2f9b-5ca4-414b-8798-ca59fa5bbfa4 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580" status: 200 len: 1756 microversion: 2.1 time: 0.147971 Aug 27 04:37:48.845983 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 382/767] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:37:48 2021] GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580 => generated 1756 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:37:49.863028 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-1fad3c53-f94d-427b-a8ac-29e01977b8a8 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:49.864082 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-1fad3c53-f94d-427b-a8ac-29e01977b8a8 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [instance: 89e425c1-0168-4f5d-8635-dd6b9f88c580] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:37:49.869942 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1fad3c53-f94d-427b-a8ac-29e01977b8a8 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:49.870323 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1fad3c53-f94d-427b-a8ac-29e01977b8a8 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:49.871076 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1fad3c53-f94d-427b-a8ac-29e01977b8a8 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:49.871502 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1fad3c53-f94d-427b-a8ac-29e01977b8a8 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:49.994613 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-1fad3c53-f94d-427b-a8ac-29e01977b8a8 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b01f24964a490da63d33097d0f9a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d957eb500948908f38f0f427a9017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:50.002211 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-1fad3c53-f94d-427b-a8ac-29e01977b8a8 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580" status: 200 len: 1756 microversion: 2.1 time: 0.143224 Aug 27 04:37:50.002776 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 386/768] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:37:49 2021] GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580 => generated 1756 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:51.021825 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-685697fb-f317-4936-8069-a2390d4c7e1c tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:51.022429 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-685697fb-f317-4936-8069-a2390d4c7e1c tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [instance: 89e425c1-0168-4f5d-8635-dd6b9f88c580] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:37:51.028532 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-685697fb-f317-4936-8069-a2390d4c7e1c tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:51.028981 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-685697fb-f317-4936-8069-a2390d4c7e1c tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:51.029763 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-685697fb-f317-4936-8069-a2390d4c7e1c tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:51.030205 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-685697fb-f317-4936-8069-a2390d4c7e1c tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:51.160552 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-685697fb-f317-4936-8069-a2390d4c7e1c tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b01f24964a490da63d33097d0f9a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d957eb500948908f38f0f427a9017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:51.168256 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-685697fb-f317-4936-8069-a2390d4c7e1c tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580" status: 200 len: 1756 microversion: 2.1 time: 0.150897 Aug 27 04:37:51.168813 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 383/769] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:37:51 2021] GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580 => generated 1756 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:52.185017 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-a8ebc159-5a37-4c5e-b34a-3aa0a0ba6b7b tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:52.185619 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-a8ebc159-5a37-4c5e-b34a-3aa0a0ba6b7b tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [instance: 89e425c1-0168-4f5d-8635-dd6b9f88c580] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:37:52.191399 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a8ebc159-5a37-4c5e-b34a-3aa0a0ba6b7b tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:52.191865 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a8ebc159-5a37-4c5e-b34a-3aa0a0ba6b7b tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:52.192646 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a8ebc159-5a37-4c5e-b34a-3aa0a0ba6b7b tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:52.193073 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a8ebc159-5a37-4c5e-b34a-3aa0a0ba6b7b tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:52.316336 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-a8ebc159-5a37-4c5e-b34a-3aa0a0ba6b7b tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b01f24964a490da63d33097d0f9a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d957eb500948908f38f0f427a9017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:52.324037 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-a8ebc159-5a37-4c5e-b34a-3aa0a0ba6b7b tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580" status: 200 len: 1756 microversion: 2.1 time: 0.142620 Aug 27 04:37:52.324602 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 387/770] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:37:52 2021] GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580 => generated 1756 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:53.343217 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-829d222f-a7c6-4881-8f91-6c4993345901 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:53.344271 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-829d222f-a7c6-4881-8f91-6c4993345901 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [instance: 89e425c1-0168-4f5d-8635-dd6b9f88c580] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:37:53.353085 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-829d222f-a7c6-4881-8f91-6c4993345901 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:53.353542 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-829d222f-a7c6-4881-8f91-6c4993345901 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:53.354351 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-829d222f-a7c6-4881-8f91-6c4993345901 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:53.354794 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-829d222f-a7c6-4881-8f91-6c4993345901 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:53.479008 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-829d222f-a7c6-4881-8f91-6c4993345901 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b01f24964a490da63d33097d0f9a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d957eb500948908f38f0f427a9017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:53.487259 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-829d222f-a7c6-4881-8f91-6c4993345901 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580" status: 200 len: 1756 microversion: 2.1 time: 0.150315 Aug 27 04:37:53.487847 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 384/771] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:37:53 2021] GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580 => generated 1756 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:54.504741 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-7c1323b2-0d70-467b-8179-ef20a0276240 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:54.505485 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-7c1323b2-0d70-467b-8179-ef20a0276240 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [instance: 89e425c1-0168-4f5d-8635-dd6b9f88c580] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:37:54.511448 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7c1323b2-0d70-467b-8179-ef20a0276240 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:54.511884 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7c1323b2-0d70-467b-8179-ef20a0276240 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:54.512665 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7c1323b2-0d70-467b-8179-ef20a0276240 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:54.513093 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7c1323b2-0d70-467b-8179-ef20a0276240 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:54.658882 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-7c1323b2-0d70-467b-8179-ef20a0276240 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b01f24964a490da63d33097d0f9a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d957eb500948908f38f0f427a9017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:54.666727 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-7c1323b2-0d70-467b-8179-ef20a0276240 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580" status: 200 len: 1756 microversion: 2.1 time: 0.166192 Aug 27 04:37:54.667291 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 388/772] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:37:54 2021] GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:37:55.684590 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-5c34b996-24c9-4daf-88f7-8d0f14c855fa tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:55.685164 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-5c34b996-24c9-4daf-88f7-8d0f14c855fa tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [instance: 89e425c1-0168-4f5d-8635-dd6b9f88c580] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:37:55.690972 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5c34b996-24c9-4daf-88f7-8d0f14c855fa tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:55.691915 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5c34b996-24c9-4daf-88f7-8d0f14c855fa tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:55.692705 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5c34b996-24c9-4daf-88f7-8d0f14c855fa tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:55.693142 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5c34b996-24c9-4daf-88f7-8d0f14c855fa tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:55.816062 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-5c34b996-24c9-4daf-88f7-8d0f14c855fa tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b01f24964a490da63d33097d0f9a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d957eb500948908f38f0f427a9017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:55.824424 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-5c34b996-24c9-4daf-88f7-8d0f14c855fa tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580" status: 200 len: 1756 microversion: 2.1 time: 0.143678 Aug 27 04:37:55.824984 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 385/773] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:37:55 2021] GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580 => generated 1756 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:37:56.841920 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-61d7028c-a43c-4553-83b6-d22bf6041941 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:56.842522 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-61d7028c-a43c-4553-83b6-d22bf6041941 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [instance: 89e425c1-0168-4f5d-8635-dd6b9f88c580] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:37:56.848943 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-61d7028c-a43c-4553-83b6-d22bf6041941 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:56.849375 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-61d7028c-a43c-4553-83b6-d22bf6041941 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:56.850124 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-61d7028c-a43c-4553-83b6-d22bf6041941 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:56.850548 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-61d7028c-a43c-4553-83b6-d22bf6041941 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:56.975959 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-61d7028c-a43c-4553-83b6-d22bf6041941 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b01f24964a490da63d33097d0f9a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d957eb500948908f38f0f427a9017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:56.983687 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-61d7028c-a43c-4553-83b6-d22bf6041941 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580" status: 200 len: 1756 microversion: 2.1 time: 0.145383 Aug 27 04:37:56.984297 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 389/774] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:37:56 2021] GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580 => generated 1756 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:58.000823 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-fe4a8b05-d452-4cdc-b6b7-2700fe01e2aa tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:58.001440 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-fe4a8b05-d452-4cdc-b6b7-2700fe01e2aa tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [instance: 89e425c1-0168-4f5d-8635-dd6b9f88c580] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:37:58.007840 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fe4a8b05-d452-4cdc-b6b7-2700fe01e2aa tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:58.008320 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fe4a8b05-d452-4cdc-b6b7-2700fe01e2aa tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:58.009092 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fe4a8b05-d452-4cdc-b6b7-2700fe01e2aa tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:58.009531 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fe4a8b05-d452-4cdc-b6b7-2700fe01e2aa tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:58.141910 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-fe4a8b05-d452-4cdc-b6b7-2700fe01e2aa tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b01f24964a490da63d33097d0f9a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d957eb500948908f38f0f427a9017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:58.150085 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-fe4a8b05-d452-4cdc-b6b7-2700fe01e2aa tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580" status: 200 len: 1756 microversion: 2.1 time: 0.152965 Aug 27 04:37:58.150643 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 386/775] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:37:57 2021] GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580 => generated 1756 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:37:59.167011 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-6238db48-1a5e-4099-948f-59ed0729aa2d tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:37:59.167615 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-6238db48-1a5e-4099-948f-59ed0729aa2d tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [instance: 89e425c1-0168-4f5d-8635-dd6b9f88c580] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:37:59.173525 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6238db48-1a5e-4099-948f-59ed0729aa2d tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:59.173974 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6238db48-1a5e-4099-948f-59ed0729aa2d tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:59.174736 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6238db48-1a5e-4099-948f-59ed0729aa2d tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:37:59.175171 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6238db48-1a5e-4099-948f-59ed0729aa2d tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:37:59.297685 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-6238db48-1a5e-4099-948f-59ed0729aa2d tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b01f24964a490da63d33097d0f9a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d957eb500948908f38f0f427a9017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:37:59.305379 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-6238db48-1a5e-4099-948f-59ed0729aa2d tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580" status: 200 len: 1756 microversion: 2.1 time: 0.142019 Aug 27 04:37:59.305870 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 390/776] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:37:59 2021] GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580 => generated 1756 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:00.322393 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-f48e8a5b-66ef-47e0-92fd-3aa559421645 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:00.323032 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-f48e8a5b-66ef-47e0-92fd-3aa559421645 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [instance: 89e425c1-0168-4f5d-8635-dd6b9f88c580] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:38:00.328923 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f48e8a5b-66ef-47e0-92fd-3aa559421645 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:00.329365 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f48e8a5b-66ef-47e0-92fd-3aa559421645 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:00.330125 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f48e8a5b-66ef-47e0-92fd-3aa559421645 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:00.330558 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f48e8a5b-66ef-47e0-92fd-3aa559421645 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:00.453662 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-f48e8a5b-66ef-47e0-92fd-3aa559421645 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b01f24964a490da63d33097d0f9a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d957eb500948908f38f0f427a9017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:00.461996 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-f48e8a5b-66ef-47e0-92fd-3aa559421645 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580" status: 200 len: 1756 microversion: 2.1 time: 0.143230 Aug 27 04:38:00.462559 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 387/777] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:38:00 2021] GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580 => generated 1756 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:01.479667 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-c09c367a-bfaf-4805-9748-56a6c47394c6 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:01.480784 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-c09c367a-bfaf-4805-9748-56a6c47394c6 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [instance: 89e425c1-0168-4f5d-8635-dd6b9f88c580] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:38:01.488391 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c09c367a-bfaf-4805-9748-56a6c47394c6 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:01.488843 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c09c367a-bfaf-4805-9748-56a6c47394c6 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:01.489619 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c09c367a-bfaf-4805-9748-56a6c47394c6 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:01.490059 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c09c367a-bfaf-4805-9748-56a6c47394c6 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:01.622444 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-c09c367a-bfaf-4805-9748-56a6c47394c6 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b01f24964a490da63d33097d0f9a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d957eb500948908f38f0f427a9017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:01.630162 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-c09c367a-bfaf-4805-9748-56a6c47394c6 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580" status: 200 len: 1756 microversion: 2.1 time: 0.155302 Aug 27 04:38:01.630723 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 391/778] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:38:01 2021] GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580 => generated 1756 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:02.647430 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-733c2e9e-4193-4aee-952e-53abb786a163 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:02.647980 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-733c2e9e-4193-4aee-952e-53abb786a163 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [instance: 89e425c1-0168-4f5d-8635-dd6b9f88c580] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:38:02.653857 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-733c2e9e-4193-4aee-952e-53abb786a163 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:02.654368 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-733c2e9e-4193-4aee-952e-53abb786a163 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:02.655082 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-733c2e9e-4193-4aee-952e-53abb786a163 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:02.655519 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-733c2e9e-4193-4aee-952e-53abb786a163 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:02.780351 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-733c2e9e-4193-4aee-952e-53abb786a163 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b01f24964a490da63d33097d0f9a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d957eb500948908f38f0f427a9017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:02.788139 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-733c2e9e-4193-4aee-952e-53abb786a163 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580" status: 200 len: 1756 microversion: 2.1 time: 0.144555 Aug 27 04:38:02.788704 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 388/779] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:38:02 2021] GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580 => generated 1756 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:38:03.805766 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-8aca03c2-fdd3-4c2a-abf1-d164c4d3c543 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:03.806378 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-8aca03c2-fdd3-4c2a-abf1-d164c4d3c543 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [instance: 89e425c1-0168-4f5d-8635-dd6b9f88c580] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:38:03.812788 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8aca03c2-fdd3-4c2a-abf1-d164c4d3c543 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:03.813242 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8aca03c2-fdd3-4c2a-abf1-d164c4d3c543 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:03.814277 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8aca03c2-fdd3-4c2a-abf1-d164c4d3c543 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:03.814705 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8aca03c2-fdd3-4c2a-abf1-d164c4d3c543 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:03.987015 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-8aca03c2-fdd3-4c2a-abf1-d164c4d3c543 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b01f24964a490da63d33097d0f9a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d957eb500948908f38f0f427a9017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:03.995406 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-8aca03c2-fdd3-4c2a-abf1-d164c4d3c543 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580" status: 200 len: 1756 microversion: 2.1 time: 0.193515 Aug 27 04:38:03.995961 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 392/780] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:38:03 2021] GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580 => generated 1756 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:05.013112 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-0c422af9-d229-422f-8a90-237985fbf168 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:05.013827 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-0c422af9-d229-422f-8a90-237985fbf168 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [instance: 89e425c1-0168-4f5d-8635-dd6b9f88c580] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:38:05.019589 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0c422af9-d229-422f-8a90-237985fbf168 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:05.020069 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0c422af9-d229-422f-8a90-237985fbf168 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:05.020832 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0c422af9-d229-422f-8a90-237985fbf168 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:05.021286 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0c422af9-d229-422f-8a90-237985fbf168 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:05.143003 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-0c422af9-d229-422f-8a90-237985fbf168 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b01f24964a490da63d33097d0f9a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d957eb500948908f38f0f427a9017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:05.153251 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-0c422af9-d229-422f-8a90-237985fbf168 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580" status: 200 len: 1756 microversion: 2.1 time: 0.143761 Aug 27 04:38:05.153817 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 389/781] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:38:05 2021] GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580 => generated 1756 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:06.170149 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-b1453057-587f-41ba-b041-4ee97d800ea6 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:06.170673 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-b1453057-587f-41ba-b041-4ee97d800ea6 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [instance: 89e425c1-0168-4f5d-8635-dd6b9f88c580] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:38:06.177063 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b1453057-587f-41ba-b041-4ee97d800ea6 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:06.177496 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b1453057-587f-41ba-b041-4ee97d800ea6 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:06.178247 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b1453057-587f-41ba-b041-4ee97d800ea6 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:06.178673 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b1453057-587f-41ba-b041-4ee97d800ea6 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:06.299955 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-b1453057-587f-41ba-b041-4ee97d800ea6 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b01f24964a490da63d33097d0f9a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d957eb500948908f38f0f427a9017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:06.308357 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-b1453057-587f-41ba-b041-4ee97d800ea6 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580" status: 200 len: 1756 microversion: 2.1 time: 0.141930 Aug 27 04:38:06.308925 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 393/782] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:38:06 2021] GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580 => generated 1756 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:07.167405 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-83379e58-6d0f-461c-b1b6-273502124a25 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "24faccc7-ec58-4f84-8e6e-2016fd7cc0f6", "device": "/dev/sdb"}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:38:07.168927 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-83379e58-6d0f-461c-b1b6-273502124a25 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] [instance: a6d0e701-d87a-47cf-8d1a-a4244db04fe9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:38:07.174867 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-83379e58-6d0f-461c-b1b6-273502124a25 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:07.175802 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-83379e58-6d0f-461c-b1b6-273502124a25 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:07.176596 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-83379e58-6d0f-461c-b1b6-273502124a25 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:07.177060 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-83379e58-6d0f-461c-b1b6-273502124a25 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:07.325820 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-ab351e06-20b5-4c28-8dc2-00e2ab5b7fe8 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:07.327195 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-ab351e06-20b5-4c28-8dc2-00e2ab5b7fe8 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [instance: 89e425c1-0168-4f5d-8635-dd6b9f88c580] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:38:07.335584 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ab351e06-20b5-4c28-8dc2-00e2ab5b7fe8 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:07.336444 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ab351e06-20b5-4c28-8dc2-00e2ab5b7fe8 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:07.337550 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ab351e06-20b5-4c28-8dc2-00e2ab5b7fe8 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:07.338587 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ab351e06-20b5-4c28-8dc2-00e2ab5b7fe8 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:07.494061 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-83379e58-6d0f-461c-b1b6-273502124a25 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] 10.222.0.53 "POST /compute/v2.1/servers/a6d0e701-d87a-47cf-8d1a-a4244db04fe9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.329754 Aug 27 04:38:07.504504 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 390/783] 10.222.0.53 () {60 vars in 1323 bytes} [Fri Aug 27 04:38:07 2021] POST /compute/v2.1/servers/a6d0e701-d87a-47cf-8d1a-a4244db04fe9/os-volume_attachments => generated 194 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:38:07.529199 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-ab351e06-20b5-4c28-8dc2-00e2ab5b7fe8 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b01f24964a490da63d33097d0f9a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d957eb500948908f38f0f427a9017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:07.537719 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-ab351e06-20b5-4c28-8dc2-00e2ab5b7fe8 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580" status: 200 len: 1759 microversion: 2.1 time: 0.215911 Aug 27 04:38:07.538515 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 394/784] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:38:07 2021] GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580 => generated 1759 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:38:23.738292 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-d8afaaf7-c68e-4025-994b-0547c05c87c7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:23.738875 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-d8afaaf7-c68e-4025-994b-0547c05c87c7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:38:23.745019 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d8afaaf7-c68e-4025-994b-0547c05c87c7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:23.745476 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d8afaaf7-c68e-4025-994b-0547c05c87c7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:23.746254 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d8afaaf7-c68e-4025-994b-0547c05c87c7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:23.746704 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d8afaaf7-c68e-4025-994b-0547c05c87c7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:23.776351 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-d8afaaf7-c68e-4025-994b-0547c05c87c7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/os-volume_attachments/282cb2bf-86aa-44ab-aa80-8cd0e54ec644" status: 200 len: 194 microversion: 2.20 time: 0.043464 Aug 27 04:38:23.777007 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 391/785] 10.222.0.53 () {60 vars in 1454 bytes} [Fri Aug 27 04:38:23 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/os-volume_attachments/282cb2bf-86aa-44ab-aa80-8cd0e54ec644 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:38:23.843053 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-eb80b0b5-3156-4a41-93b4-aed88ba40b23 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:23.843576 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-eb80b0b5-3156-4a41-93b4-aed88ba40b23 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:38:23.849704 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-eb80b0b5-3156-4a41-93b4-aed88ba40b23 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:23.850148 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-eb80b0b5-3156-4a41-93b4-aed88ba40b23 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:23.850906 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-eb80b0b5-3156-4a41-93b4-aed88ba40b23 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:23.851334 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-eb80b0b5-3156-4a41-93b4-aed88ba40b23 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:23.935243 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.objects.instance [None req-eb80b0b5-3156-4a41-93b4-aed88ba40b23 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lazy-loading 'services' on Instance uuid b3173859-725e-4d66-80af-4223a6643935 {{(pid=108971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:38:24.000286 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-eb80b0b5-3156-4a41-93b4-aed88ba40b23 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "DELETE /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/os-volume_attachments/282cb2bf-86aa-44ab-aa80-8cd0e54ec644" status: 202 len: 0 microversion: 2.20 time: 0.160751 Aug 27 04:38:24.000874 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 395/786] 10.222.0.53 () {60 vars in 1457 bytes} [Fri Aug 27 04:38:23 2021] DELETE /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/os-volume_attachments/282cb2bf-86aa-44ab-aa80-8cd0e54ec644 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:38:24.009868 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-7632827a-b63b-45ca-8fc5-3e5f71ef8690 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:24.010875 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-7632827a-b63b-45ca-8fc5-3e5f71ef8690 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:38:24.017055 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7632827a-b63b-45ca-8fc5-3e5f71ef8690 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:24.017665 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7632827a-b63b-45ca-8fc5-3e5f71ef8690 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:24.018612 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7632827a-b63b-45ca-8fc5-3e5f71ef8690 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:24.019112 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7632827a-b63b-45ca-8fc5-3e5f71ef8690 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:24.049460 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-7632827a-b63b-45ca-8fc5-3e5f71ef8690 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043506 Aug 27 04:38:24.050561 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 392/787] 10.222.0.53 () {60 vars in 1343 bytes} [Fri Aug 27 04:38:24 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:38:25.062751 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-beba0d6a-fb1b-4ff4-9488-8c3ad73876ef tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:25.063796 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-beba0d6a-fb1b-4ff4-9488-8c3ad73876ef tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:38:25.070216 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-beba0d6a-fb1b-4ff4-9488-8c3ad73876ef tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:25.070700 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-beba0d6a-fb1b-4ff4-9488-8c3ad73876ef tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:25.071554 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-beba0d6a-fb1b-4ff4-9488-8c3ad73876ef tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:25.072018 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-beba0d6a-fb1b-4ff4-9488-8c3ad73876ef tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:25.101728 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-beba0d6a-fb1b-4ff4-9488-8c3ad73876ef tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043335 Aug 27 04:38:25.102292 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 396/788] 10.222.0.53 () {60 vars in 1343 bytes} [Fri Aug 27 04:38:25 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:38:26.114504 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-f1a0e19b-e051-4db2-af68-84e69c0acd06 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:26.115438 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-f1a0e19b-e051-4db2-af68-84e69c0acd06 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:38:26.121859 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f1a0e19b-e051-4db2-af68-84e69c0acd06 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:26.122303 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f1a0e19b-e051-4db2-af68-84e69c0acd06 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:26.123075 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f1a0e19b-e051-4db2-af68-84e69c0acd06 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:26.123510 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f1a0e19b-e051-4db2-af68-84e69c0acd06 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:26.154317 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-f1a0e19b-e051-4db2-af68-84e69c0acd06 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044540 Aug 27 04:38:26.154789 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 393/789] 10.222.0.53 () {60 vars in 1343 bytes} [Fri Aug 27 04:38:26 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:38:27.166349 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-27a4aea5-56f7-4fda-9378-46a8701a5579 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:27.167246 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-27a4aea5-56f7-4fda-9378-46a8701a5579 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:38:27.173173 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-27a4aea5-56f7-4fda-9378-46a8701a5579 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:27.173615 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-27a4aea5-56f7-4fda-9378-46a8701a5579 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:27.174376 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-27a4aea5-56f7-4fda-9378-46a8701a5579 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:27.175299 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-27a4aea5-56f7-4fda-9378-46a8701a5579 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:27.204865 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-27a4aea5-56f7-4fda-9378-46a8701a5579 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042297 Aug 27 04:38:27.205427 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 397/790] 10.222.0.53 () {60 vars in 1343 bytes} [Fri Aug 27 04:38:27 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:38:28.216941 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-cfc31adb-e1fd-4b07-a7c0-8e6c4a01e160 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:28.217892 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-cfc31adb-e1fd-4b07-a7c0-8e6c4a01e160 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:38:28.223971 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-cfc31adb-e1fd-4b07-a7c0-8e6c4a01e160 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:28.224439 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-cfc31adb-e1fd-4b07-a7c0-8e6c4a01e160 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:28.225199 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-cfc31adb-e1fd-4b07-a7c0-8e6c4a01e160 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:28.225630 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-cfc31adb-e1fd-4b07-a7c0-8e6c4a01e160 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:28.254880 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-cfc31adb-e1fd-4b07-a7c0-8e6c4a01e160 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041695 Aug 27 04:38:28.255432 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 394/791] 10.222.0.53 () {60 vars in 1343 bytes} [Fri Aug 27 04:38:28 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:38:29.266455 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-2d8b4f65-a0aa-44f5-8252-f9bab4bc8aa2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:29.267350 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-2d8b4f65-a0aa-44f5-8252-f9bab4bc8aa2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:38:29.273238 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-2d8b4f65-a0aa-44f5-8252-f9bab4bc8aa2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:29.273679 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-2d8b4f65-a0aa-44f5-8252-f9bab4bc8aa2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:29.274424 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-2d8b4f65-a0aa-44f5-8252-f9bab4bc8aa2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:29.274847 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-2d8b4f65-a0aa-44f5-8252-f9bab4bc8aa2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:29.305128 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-2d8b4f65-a0aa-44f5-8252-f9bab4bc8aa2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042351 Aug 27 04:38:29.305712 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 398/792] 10.222.0.53 () {60 vars in 1343 bytes} [Fri Aug 27 04:38:29 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:38:30.316965 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-ace0ffcb-f2c3-47a7-8bc3-4e1021afc1f2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:30.318221 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-ace0ffcb-f2c3-47a7-8bc3-4e1021afc1f2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:38:30.324737 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ace0ffcb-f2c3-47a7-8bc3-4e1021afc1f2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:30.325192 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ace0ffcb-f2c3-47a7-8bc3-4e1021afc1f2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:30.325966 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ace0ffcb-f2c3-47a7-8bc3-4e1021afc1f2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:30.326415 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ace0ffcb-f2c3-47a7-8bc3-4e1021afc1f2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:30.355767 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-ace0ffcb-f2c3-47a7-8bc3-4e1021afc1f2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043351 Aug 27 04:38:30.356381 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 395/793] 10.222.0.53 () {60 vars in 1343 bytes} [Fri Aug 27 04:38:30 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:38:30.421062 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-6ef9812d-157f-40a5-8589-ae6efe38b02e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:30.421618 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-6ef9812d-157f-40a5-8589-ae6efe38b02e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:38:30.427899 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6ef9812d-157f-40a5-8589-ae6efe38b02e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:30.428368 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6ef9812d-157f-40a5-8589-ae6efe38b02e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:30.429128 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6ef9812d-157f-40a5-8589-ae6efe38b02e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:30.429653 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6ef9812d-157f-40a5-8589-ae6efe38b02e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:30.454134 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-6ef9812d-157f-40a5-8589-ae6efe38b02e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Going to try to terminate instance {{(pid=108971) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 04:38:30.530474 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-6ef9812d-157f-40a5-8589-ae6efe38b02e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "DELETE /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 204 len: 0 microversion: 2.20 time: 0.112745 Aug 27 04:38:30.531117 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 399/794] 10.222.0.53 () {60 vars in 1280 bytes} [Fri Aug 27 04:38:30 2021] DELETE /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 04:38:30.540864 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-fbbca71e-30ec-4f46-800a-042c381371f5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:30.541499 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-fbbca71e-30ec-4f46-800a-042c381371f5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:38:30.547316 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fbbca71e-30ec-4f46-800a-042c381371f5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:30.547761 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fbbca71e-30ec-4f46-800a-042c381371f5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:30.548551 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fbbca71e-30ec-4f46-800a-042c381371f5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:30.548983 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fbbca71e-30ec-4f46-800a-042c381371f5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:30.670991 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-fbbca71e-30ec-4f46-800a-042c381371f5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:30.679546 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-fbbca71e-30ec-4f46-800a-042c381371f5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:30.681075 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-fbbca71e-30ec-4f46-800a-042c381371f5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:30.682206 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-fbbca71e-30ec-4f46-800a-042c381371f5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1724 microversion: 2.20 time: 0.145058 Aug 27 04:38:30.682772 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 396/795] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:38:30 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1724 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:38:31.701053 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-36dfe0a1-1b49-4280-9e46-fa13ee06e6ed tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:31.701655 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-36dfe0a1-1b49-4280-9e46-fa13ee06e6ed tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:38:31.708708 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-36dfe0a1-1b49-4280-9e46-fa13ee06e6ed tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:31.709159 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-36dfe0a1-1b49-4280-9e46-fa13ee06e6ed tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:31.709937 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-36dfe0a1-1b49-4280-9e46-fa13ee06e6ed tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:31.710374 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-36dfe0a1-1b49-4280-9e46-fa13ee06e6ed tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:31.837221 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-36dfe0a1-1b49-4280-9e46-fa13ee06e6ed tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:31.845122 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-36dfe0a1-1b49-4280-9e46-fa13ee06e6ed tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:31.847200 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-36dfe0a1-1b49-4280-9e46-fa13ee06e6ed tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:31.848508 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-36dfe0a1-1b49-4280-9e46-fa13ee06e6ed tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1724 microversion: 2.20 time: 0.151486 Aug 27 04:38:31.849075 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 400/796] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:38:31 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:38:32.866694 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-b41b9197-e241-433c-bb0f-821d4c6d651d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:32.867307 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-b41b9197-e241-433c-bb0f-821d4c6d651d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:38:32.873327 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b41b9197-e241-433c-bb0f-821d4c6d651d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:32.873778 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b41b9197-e241-433c-bb0f-821d4c6d651d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:32.874590 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b41b9197-e241-433c-bb0f-821d4c6d651d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:32.875036 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b41b9197-e241-433c-bb0f-821d4c6d651d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:33.000950 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-b41b9197-e241-433c-bb0f-821d4c6d651d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:33.010100 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-b41b9197-e241-433c-bb0f-821d4c6d651d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:33.011641 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-b41b9197-e241-433c-bb0f-821d4c6d651d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:33.012808 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-b41b9197-e241-433c-bb0f-821d4c6d651d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1724 microversion: 2.20 time: 0.149879 Aug 27 04:38:33.013384 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 397/797] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:38:32 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:38:34.030495 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-9639415f-97b7-4235-bc44-ab9578f7b0de tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:34.031089 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-9639415f-97b7-4235-bc44-ab9578f7b0de tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:38:34.036995 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9639415f-97b7-4235-bc44-ab9578f7b0de tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:34.037437 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9639415f-97b7-4235-bc44-ab9578f7b0de tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:34.038188 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9639415f-97b7-4235-bc44-ab9578f7b0de tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:34.038617 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9639415f-97b7-4235-bc44-ab9578f7b0de tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:34.162258 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-9639415f-97b7-4235-bc44-ab9578f7b0de tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:34.170408 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-9639415f-97b7-4235-bc44-ab9578f7b0de tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:34.171889 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-9639415f-97b7-4235-bc44-ab9578f7b0de tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:34.173043 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-9639415f-97b7-4235-bc44-ab9578f7b0de tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1724 microversion: 2.20 time: 0.146247 Aug 27 04:38:34.173592 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 401/798] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:38:34 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1724 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:38:35.191877 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-3c3913ba-712f-4879-9a51-c626562d0791 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:35.192516 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-3c3913ba-712f-4879-9a51-c626562d0791 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:38:35.198418 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3c3913ba-712f-4879-9a51-c626562d0791 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:35.198872 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3c3913ba-712f-4879-9a51-c626562d0791 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:35.199644 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3c3913ba-712f-4879-9a51-c626562d0791 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:35.200118 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3c3913ba-712f-4879-9a51-c626562d0791 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:35.320613 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-3c3913ba-712f-4879-9a51-c626562d0791 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:35.328373 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-3c3913ba-712f-4879-9a51-c626562d0791 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:35.329877 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-3c3913ba-712f-4879-9a51-c626562d0791 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:35.331620 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-3c3913ba-712f-4879-9a51-c626562d0791 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1724 microversion: 2.20 time: 0.143531 Aug 27 04:38:35.332216 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 398/799] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:38:35 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1724 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:38:36.350278 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-3a772e65-199a-450a-99ad-c4d2960c18f3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:36.350893 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-3a772e65-199a-450a-99ad-c4d2960c18f3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:38:36.356987 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3a772e65-199a-450a-99ad-c4d2960c18f3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:36.357428 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3a772e65-199a-450a-99ad-c4d2960c18f3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:36.358191 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3a772e65-199a-450a-99ad-c4d2960c18f3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:36.358623 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3a772e65-199a-450a-99ad-c4d2960c18f3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:36.482540 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-3a772e65-199a-450a-99ad-c4d2960c18f3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:36.491072 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-3a772e65-199a-450a-99ad-c4d2960c18f3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:36.492616 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-3a772e65-199a-450a-99ad-c4d2960c18f3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:36.493735 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-3a772e65-199a-450a-99ad-c4d2960c18f3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1724 microversion: 2.20 time: 0.147772 Aug 27 04:38:36.494295 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 402/800] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:38:36 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:38:37.512158 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-2a1c729a-7672-4801-a2a7-78c89576b985 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:37.512933 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-2a1c729a-7672-4801-a2a7-78c89576b985 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:38:37.519482 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2a1c729a-7672-4801-a2a7-78c89576b985 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:37.519934 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2a1c729a-7672-4801-a2a7-78c89576b985 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:37.520730 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2a1c729a-7672-4801-a2a7-78c89576b985 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:37.521170 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2a1c729a-7672-4801-a2a7-78c89576b985 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:37.643526 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-2a1c729a-7672-4801-a2a7-78c89576b985 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:37.651744 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-2a1c729a-7672-4801-a2a7-78c89576b985 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:37.653295 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-2a1c729a-7672-4801-a2a7-78c89576b985 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:37.654447 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-2a1c729a-7672-4801-a2a7-78c89576b985 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1724 microversion: 2.20 time: 0.146134 Aug 27 04:38:37.654996 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 399/801] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:38:37 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1724 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:38:38.672612 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-b029d409-acf0-4f1a-ba36-a2369e2190f5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:38.673427 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-b029d409-acf0-4f1a-ba36-a2369e2190f5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:38:38.680256 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b029d409-acf0-4f1a-ba36-a2369e2190f5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:38.680485 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b029d409-acf0-4f1a-ba36-a2369e2190f5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:38.681322 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b029d409-acf0-4f1a-ba36-a2369e2190f5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:38.681686 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b029d409-acf0-4f1a-ba36-a2369e2190f5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:38.972239 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-b029d409-acf0-4f1a-ba36-a2369e2190f5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:38.983842 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-b029d409-acf0-4f1a-ba36-a2369e2190f5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:38.987350 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-b029d409-acf0-4f1a-ba36-a2369e2190f5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:38.989349 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-b029d409-acf0-4f1a-ba36-a2369e2190f5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 200 len: 1657 microversion: 2.20 time: 0.320512 Aug 27 04:38:38.990537 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 403/802] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:38:38 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 1657 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:38:39.198327 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [req-41354065-f96f-4eb6-ab0e-e4bc45ee0b0e req-d3bd6dad-c4d4-4afa-bb01-233d4bdba96d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3173859-725e-4d66-80af-4223a6643935", "name": "network-vif-deleted", "tag": "698af269-46a5-4892-822b-9ef4aa21fa2e"}]} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:38:39.200027 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:38:39.200027 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: warnings.warn(msg) Aug 27 04:38:39.208899 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-41354065-f96f-4eb6-ab0e-e4bc45ee0b0e req-d3bd6dad-c4d4-4afa-bb01-233d4bdba96d service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:39.209393 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-41354065-f96f-4eb6-ab0e-e4bc45ee0b0e req-d3bd6dad-c4d4-4afa-bb01-233d4bdba96d service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:39.222214 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.compute.server_external_events [req-41354065-f96f-4eb6-ab0e-e4bc45ee0b0e req-d3bd6dad-c4d4-4afa-bb01-233d4bdba96d service nova] Creating event network-vif-deleted:698af269-46a5-4892-822b-9ef4aa21fa2e for instance b3173859-725e-4d66-80af-4223a6643935 on hv-cinder-80403 Aug 27 04:38:39.229020 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [req-41354065-f96f-4eb6-ab0e-e4bc45ee0b0e req-d3bd6dad-c4d4-4afa-bb01-233d4bdba96d service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034523 Aug 27 04:38:39.230020 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 400/803] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:38:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:38:40.021564 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-c880b2c3-e389-4db7-be14-49275574cfb5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:40.024864 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-c880b2c3-e389-4db7-be14-49275574cfb5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:38:40.044240 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c880b2c3-e389-4db7-be14-49275574cfb5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:40.045332 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c880b2c3-e389-4db7-be14-49275574cfb5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:40.047092 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c880b2c3-e389-4db7-be14-49275574cfb5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:40.048442 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c880b2c3-e389-4db7-be14-49275574cfb5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:40.071384 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.wsgi [None req-c880b2c3-e389-4db7-be14-49275574cfb5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] HTTP exception thrown: Instance b3173859-725e-4d66-80af-4223a6643935 could not be found. Aug 27 04:38:40.072868 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-c880b2c3-e389-4db7-be14-49275574cfb5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Returning 404 to user: Instance b3173859-725e-4d66-80af-4223a6643935 could not be found. {{(pid=108971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:38:40.074100 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-c880b2c3-e389-4db7-be14-49275574cfb5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 404 len: 111 microversion: 2.20 time: 0.059791 Aug 27 04:38:40.079608 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 404/804] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:38:40 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:38:40.084916 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-0de2e548-3797-4558-a779-61b580a52a85 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '.version_select at 0x7f206be29430>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:40.109937 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-0de2e548-3797-4558-a779-61b580a52a85 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-839120903" status: 204 len: 0 microversion: 2.20 time: 0.029526 Aug 27 04:38:40.110994 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 401/805] 10.222.0.53 () {60 vars in 1259 bytes} [Fri Aug 27 04:38:40 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-839120903 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 27 04:38:40.431015 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-d67da7ea-012f-4701-8b55-a6bdc5049734 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:40.438468 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-d67da7ea-012f-4701-8b55-a6bdc5049734 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] [instance: a6d0e701-d87a-47cf-8d1a-a4244db04fe9] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:38:40.448092 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d67da7ea-012f-4701-8b55-a6bdc5049734 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:40.449170 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d67da7ea-012f-4701-8b55-a6bdc5049734 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:40.451096 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d67da7ea-012f-4701-8b55-a6bdc5049734 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:40.452144 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d67da7ea-012f-4701-8b55-a6bdc5049734 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:40.591720 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.objects.instance [None req-d67da7ea-012f-4701-8b55-a6bdc5049734 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lazy-loading 'services' on Instance uuid a6d0e701-d87a-47cf-8d1a-a4244db04fe9 {{(pid=108971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:38:40.698270 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-d67da7ea-012f-4701-8b55-a6bdc5049734 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] 10.222.0.53 "DELETE /compute/v2.1/servers/a6d0e701-d87a-47cf-8d1a-a4244db04fe9/os-volume_attachments/24faccc7-ec58-4f84-8e6e-2016fd7cc0f6" status: 202 len: 0 microversion: 2.1 time: 0.270913 Aug 27 04:38:40.699262 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 405/806] 10.222.0.53 () {58 vars in 1416 bytes} [Fri Aug 27 04:38:40 2021] DELETE /compute/v2.1/servers/a6d0e701-d87a-47cf-8d1a-a4244db04fe9/os-volume_attachments/24faccc7-ec58-4f84-8e6e-2016fd7cc0f6 => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:38:41.018938 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-8f80431d-f373-46eb-8380-c0e96af735e2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'create', calling method: .version_select at 0x7f206bebcc10>, body: {"keypair": {"name": "tempest-keypair-1791509285"}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:38:41.037883 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.quota [None req-8f80431d-f373-46eb-8380-c0e96af735e2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Getting quotas for project a6be58896fed46208a356cedf5a8513e. Resources: {'key_pairs'} {{(pid=108970) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:38:41.042287 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.quota [None req-8f80431d-f373-46eb-8380-c0e96af735e2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Getting quotas for user ebedf95669444aa29994308a5f59ee2d and project a6be58896fed46208a356cedf5a8513e. Resources: {'key_pairs'} {{(pid=108970) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:38:41.222123 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.quota [None req-8f80431d-f373-46eb-8380-c0e96af735e2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Getting quotas for project a6be58896fed46208a356cedf5a8513e. Resources: {'key_pairs'} {{(pid=108970) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:38:41.225743 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.quota [None req-8f80431d-f373-46eb-8380-c0e96af735e2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Getting quotas for user ebedf95669444aa29994308a5f59ee2d and project a6be58896fed46208a356cedf5a8513e. Resources: {'key_pairs'} {{(pid=108970) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:38:41.239345 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-8f80431d-f373-46eb-8380-c0e96af735e2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.224844 Aug 27 04:38:41.239949 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 402/807] 10.222.0.53 () {62 vars in 1199 bytes} [Fri Aug 27 04:38:41 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 226 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Aug 27 04:38:42.571341 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-ef790c74-09d9-4e71-ad3b-fdd566b56691 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1766018080", "imageRef": "9356e2fa-e55b-41d9-9ca4-53393f2d79fd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2d12ac97-d989-4330-872d-92f5fe3f8e57"}], "security_groups": [{"name": "tempest-securitygroup--1507845504"}], "key_name": "tempest-keypair-1791509285", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:38:42.663751 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.network.neutron [None req-ef790c74-09d9-4e71-ad3b-fdd566b56691 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] validate_networks() for [('2d12ac97-d989-4330-872d-92f5fe3f8e57', None, None, None, None, None)] {{(pid=108971) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 04:38:42.925320 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-d3c5a0e5-17f8-4249-9881-a1a76f79e08b tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:42.925923 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-d3c5a0e5-17f8-4249-9881-a1a76f79e08b tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] [instance: a6d0e701-d87a-47cf-8d1a-a4244db04fe9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:38:42.932116 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d3c5a0e5-17f8-4249-9881-a1a76f79e08b tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:42.932571 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d3c5a0e5-17f8-4249-9881-a1a76f79e08b tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:42.933351 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d3c5a0e5-17f8-4249-9881-a1a76f79e08b tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:42.933794 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d3c5a0e5-17f8-4249-9881-a1a76f79e08b tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:42.959071 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-d3c5a0e5-17f8-4249-9881-a1a76f79e08b tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] [instance: a6d0e701-d87a-47cf-8d1a-a4244db04fe9] Going to try to terminate instance {{(pid=108970) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 04:38:43.036390 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-d3c5a0e5-17f8-4249-9881-a1a76f79e08b tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] 10.222.0.53 "DELETE /compute/v2.1/servers/a6d0e701-d87a-47cf-8d1a-a4244db04fe9" status: 204 len: 0 microversion: 2.1 time: 0.114987 Aug 27 04:38:43.037307 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 403/808] 10.222.0.53 () {58 vars in 1239 bytes} [Fri Aug 27 04:38:42 2021] DELETE /compute/v2.1/servers/a6d0e701-d87a-47cf-8d1a-a4244db04fe9 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 04:38:43.051814 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-9d1fa69a-896e-457c-82b1-4323cf22b611 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:43.052643 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-9d1fa69a-896e-457c-82b1-4323cf22b611 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] [instance: a6d0e701-d87a-47cf-8d1a-a4244db04fe9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:38:43.059861 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9d1fa69a-896e-457c-82b1-4323cf22b611 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:43.060355 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9d1fa69a-896e-457c-82b1-4323cf22b611 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:43.061142 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9d1fa69a-896e-457c-82b1-4323cf22b611 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:43.061575 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9d1fa69a-896e-457c-82b1-4323cf22b611 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:43.092137 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.virt.hardware [None req-ef790c74-09d9-4e71-ad3b-fdd566b56691 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Flavor limits 0:0:0 {{(pid=108971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:38:43.092721 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.virt.hardware [None req-ef790c74-09d9-4e71-ad3b-fdd566b56691 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Image limits 0:0:0 {{(pid=108971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:38:43.093320 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.virt.hardware [None req-ef790c74-09d9-4e71-ad3b-fdd566b56691 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Flavor pref 0:0:0 {{(pid=108971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:38:43.093826 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.virt.hardware [None req-ef790c74-09d9-4e71-ad3b-fdd566b56691 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Image pref 0:0:0 {{(pid=108971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:38:43.094323 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.virt.hardware [None req-ef790c74-09d9-4e71-ad3b-fdd566b56691 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:38:43.104733 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ef790c74-09d9-4e71-ad3b-fdd566b56691 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:43.105167 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ef790c74-09d9-4e71-ad3b-fdd566b56691 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:43.105960 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ef790c74-09d9-4e71-ad3b-fdd566b56691 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:43.106442 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ef790c74-09d9-4e71-ad3b-fdd566b56691 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:43.124314 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.quota [None req-ef790c74-09d9-4e71-ad3b-fdd566b56691 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Getting quotas for project a6be58896fed46208a356cedf5a8513e. Resources: {'ram', 'cores', 'instances'} {{(pid=108971) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:38:43.129010 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.quota [None req-ef790c74-09d9-4e71-ad3b-fdd566b56691 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Getting quotas for user ebedf95669444aa29994308a5f59ee2d and project a6be58896fed46208a356cedf5a8513e. Resources: {'ram', 'cores', 'instances'} {{(pid=108971) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:38:43.140505 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-ef790c74-09d9-4e71-ad3b-fdd566b56691 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Going to run 1 instances... {{(pid=108971) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 04:38:43.143567 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-ef790c74-09d9-4e71-ad3b-fdd566b56691 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9356e2fa-e55b-41d9-9ca4-53393f2d79fd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 04:38:43.193327 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-ef790c74-09d9-4e71-ad3b-fdd566b56691 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.626304 Aug 27 04:38:43.194234 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 406/809] 10.222.0.53 () {62 vars in 1188 bytes} [Fri Aug 27 04:38:42 2021] POST /compute/v2.1/servers => generated 402 bytes in 628 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 04:38:43.204426 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-0163aa61-a5ab-4b87-81a6-234e119f5f26 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:43.204886 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-9d1fa69a-896e-457c-82b1-4323cf22b611 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175c169d2bfb4f0f89e2fdfe8485c999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbf39b95058423f95015e37925d1a8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:43.206005 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-0163aa61-a5ab-4b87-81a6-234e119f5f26 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:38:43.213408 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-9d1fa69a-896e-457c-82b1-4323cf22b611 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] 10.222.0.53 "GET /compute/v2.1/servers/a6d0e701-d87a-47cf-8d1a-a4244db04fe9" status: 200 len: 1514 microversion: 2.1 time: 0.169616 Aug 27 04:38:43.214570 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 404/810] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:38:43 2021] GET /compute/v2.1/servers/a6d0e701-d87a-47cf-8d1a-a4244db04fe9 => generated 1514 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:43.265697 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-0163aa61-a5ab-4b87-81a6-234e119f5f26 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:43.274943 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-0163aa61-a5ab-4b87-81a6-234e119f5f26 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:43.276827 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-0163aa61-a5ab-4b87-81a6-234e119f5f26 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:43.278098 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-0163aa61-a5ab-4b87-81a6-234e119f5f26 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1282 microversion: 2.20 time: 0.077681 Aug 27 04:38:43.278905 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 407/811] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:38:43 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1282 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:38:44.231361 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-b869782d-f4d6-4078-bcbc-beda3679aedb tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:44.232020 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-b869782d-f4d6-4078-bcbc-beda3679aedb tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] [instance: a6d0e701-d87a-47cf-8d1a-a4244db04fe9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:38:44.238665 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b869782d-f4d6-4078-bcbc-beda3679aedb tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:44.239133 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b869782d-f4d6-4078-bcbc-beda3679aedb tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:44.239888 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b869782d-f4d6-4078-bcbc-beda3679aedb tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:44.240343 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b869782d-f4d6-4078-bcbc-beda3679aedb tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:44.296577 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-aaa0e270-23a3-4c08-8275-1b7f64df02f0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:44.297965 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-aaa0e270-23a3-4c08-8275-1b7f64df02f0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:38:44.305109 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-aaa0e270-23a3-4c08-8275-1b7f64df02f0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:44.305704 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-aaa0e270-23a3-4c08-8275-1b7f64df02f0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:44.306535 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-aaa0e270-23a3-4c08-8275-1b7f64df02f0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:44.307624 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-aaa0e270-23a3-4c08-8275-1b7f64df02f0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:44.389995 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-aaa0e270-23a3-4c08-8275-1b7f64df02f0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:44.401725 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-aaa0e270-23a3-4c08-8275-1b7f64df02f0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:44.403311 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-aaa0e270-23a3-4c08-8275-1b7f64df02f0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:44.404882 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-aaa0e270-23a3-4c08-8275-1b7f64df02f0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1352 microversion: 2.20 time: 0.111713 Aug 27 04:38:44.405603 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 408/812] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:38:44 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1352 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:38:44.414149 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-b869782d-f4d6-4078-bcbc-beda3679aedb tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175c169d2bfb4f0f89e2fdfe8485c999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbf39b95058423f95015e37925d1a8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:44.421698 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-b869782d-f4d6-4078-bcbc-beda3679aedb tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] 10.222.0.53 "GET /compute/v2.1/servers/a6d0e701-d87a-47cf-8d1a-a4244db04fe9" status: 200 len: 1514 microversion: 2.1 time: 0.194114 Aug 27 04:38:44.422272 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 405/813] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:38:44 2021] GET /compute/v2.1/servers/a6d0e701-d87a-47cf-8d1a-a4244db04fe9 => generated 1514 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:45.424789 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-812e7f92-f067-4d80-91b7-faaa7cb72c91 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:45.425478 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-812e7f92-f067-4d80-91b7-faaa7cb72c91 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:38:45.432011 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-812e7f92-f067-4d80-91b7-faaa7cb72c91 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:45.433703 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-812e7f92-f067-4d80-91b7-faaa7cb72c91 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:45.433703 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-812e7f92-f067-4d80-91b7-faaa7cb72c91 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:45.433703 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-812e7f92-f067-4d80-91b7-faaa7cb72c91 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:45.438879 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-9eb59bb7-6319-4799-9d48-2ed3d3cad4a3 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:45.441293 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-9eb59bb7-6319-4799-9d48-2ed3d3cad4a3 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] [instance: a6d0e701-d87a-47cf-8d1a-a4244db04fe9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:38:45.449132 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9eb59bb7-6319-4799-9d48-2ed3d3cad4a3 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:45.449592 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9eb59bb7-6319-4799-9d48-2ed3d3cad4a3 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:45.450450 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9eb59bb7-6319-4799-9d48-2ed3d3cad4a3 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:45.450895 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9eb59bb7-6319-4799-9d48-2ed3d3cad4a3 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:45.605215 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-9eb59bb7-6319-4799-9d48-2ed3d3cad4a3 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175c169d2bfb4f0f89e2fdfe8485c999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbf39b95058423f95015e37925d1a8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:45.616342 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-9eb59bb7-6319-4799-9d48-2ed3d3cad4a3 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] 10.222.0.53 "GET /compute/v2.1/servers/a6d0e701-d87a-47cf-8d1a-a4244db04fe9" status: 200 len: 1514 microversion: 2.1 time: 0.181083 Aug 27 04:38:45.616942 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 406/814] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:38:45 2021] GET /compute/v2.1/servers/a6d0e701-d87a-47cf-8d1a-a4244db04fe9 => generated 1514 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:38:45.637223 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-812e7f92-f067-4d80-91b7-faaa7cb72c91 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:45.646813 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-812e7f92-f067-4d80-91b7-faaa7cb72c91 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:45.648575 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-812e7f92-f067-4d80-91b7-faaa7cb72c91 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:45.649726 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-812e7f92-f067-4d80-91b7-faaa7cb72c91 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1408 microversion: 2.20 time: 0.228648 Aug 27 04:38:45.650490 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 409/815] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:38:45 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1408 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:38:45.788624 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [req-007411c7-4055-4892-ad45-4c6c320bf2af req-316c86da-f7ec-42ef-b614-da3d1200010a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bbb8317-81d9-4e49-bd0b-32a4446ec505", "tag": "792a8fdf-832a-4455-8433-eb97d588eb8e"}]} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:38:45.790256 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:38:45.790256 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: warnings.warn(msg) Aug 27 04:38:45.798244 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-007411c7-4055-4892-ad45-4c6c320bf2af req-316c86da-f7ec-42ef-b614-da3d1200010a service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:45.799285 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-007411c7-4055-4892-ad45-4c6c320bf2af req-316c86da-f7ec-42ef-b614-da3d1200010a service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:45.814093 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.compute.server_external_events [req-007411c7-4055-4892-ad45-4c6c320bf2af req-316c86da-f7ec-42ef-b614-da3d1200010a service nova] Creating event network-changed:792a8fdf-832a-4455-8433-eb97d588eb8e for instance 4bbb8317-81d9-4e49-bd0b-32a4446ec505 on hv-cinder-80403 Aug 27 04:38:45.819627 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [req-007411c7-4055-4892-ad45-4c6c320bf2af req-316c86da-f7ec-42ef-b614-da3d1200010a service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034966 Aug 27 04:38:45.820464 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 407/816] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:38:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:38:46.630383 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [req-af53f660-71ab-490e-b558-18f5a2dd42f0 req-5d96b4fb-6b09-45f4-80fd-05eb5623ee4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6d0e701-d87a-47cf-8d1a-a4244db04fe9", "name": "network-vif-deleted", "tag": "4d991ffc-660b-476d-9195-4a393686c29d"}]} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:38:46.632051 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:38:46.632051 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: warnings.warn(msg) Aug 27 04:38:46.634100 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-746f24e7-6307-4967-9bf3-59121a1bc5b9 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:46.634807 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-746f24e7-6307-4967-9bf3-59121a1bc5b9 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] [instance: a6d0e701-d87a-47cf-8d1a-a4244db04fe9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:38:46.641099 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-746f24e7-6307-4967-9bf3-59121a1bc5b9 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:46.641313 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-af53f660-71ab-490e-b558-18f5a2dd42f0 req-5d96b4fb-6b09-45f4-80fd-05eb5623ee4d service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:46.641648 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-af53f660-71ab-490e-b558-18f5a2dd42f0 req-5d96b4fb-6b09-45f4-80fd-05eb5623ee4d service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:46.641773 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-746f24e7-6307-4967-9bf3-59121a1bc5b9 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:46.643034 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-746f24e7-6307-4967-9bf3-59121a1bc5b9 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:46.643498 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-746f24e7-6307-4967-9bf3-59121a1bc5b9 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:46.655005 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.compute.server_external_events [req-af53f660-71ab-490e-b558-18f5a2dd42f0 req-5d96b4fb-6b09-45f4-80fd-05eb5623ee4d service nova] Creating event network-vif-deleted:4d991ffc-660b-476d-9195-4a393686c29d for instance a6d0e701-d87a-47cf-8d1a-a4244db04fe9 on hv-cinder-80403 Aug 27 04:38:46.661985 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [req-af53f660-71ab-490e-b558-18f5a2dd42f0 req-5d96b4fb-6b09-45f4-80fd-05eb5623ee4d service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094416 Aug 27 04:38:46.663169 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 410/817] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:38:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:38:46.669416 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-96c52715-ec96-460d-95e9-f8799daf020c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:46.670375 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-96c52715-ec96-460d-95e9-f8799daf020c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:38:46.677399 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-96c52715-ec96-460d-95e9-f8799daf020c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:46.677868 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-96c52715-ec96-460d-95e9-f8799daf020c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:46.678645 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-96c52715-ec96-460d-95e9-f8799daf020c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:46.679084 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-96c52715-ec96-460d-95e9-f8799daf020c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:46.709656 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-746f24e7-6307-4967-9bf3-59121a1bc5b9 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175c169d2bfb4f0f89e2fdfe8485c999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbf39b95058423f95015e37925d1a8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:46.717274 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-746f24e7-6307-4967-9bf3-59121a1bc5b9 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] 10.222.0.53 "GET /compute/v2.1/servers/a6d0e701-d87a-47cf-8d1a-a4244db04fe9" status: 200 len: 1303 microversion: 2.1 time: 0.087368 Aug 27 04:38:46.717855 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 408/818] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:38:46 2021] GET /compute/v2.1/servers/a6d0e701-d87a-47cf-8d1a-a4244db04fe9 => generated 1303 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:38:46.869170 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-96c52715-ec96-460d-95e9-f8799daf020c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:46.878139 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-96c52715-ec96-460d-95e9-f8799daf020c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:46.879663 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-96c52715-ec96-460d-95e9-f8799daf020c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:46.880772 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-96c52715-ec96-460d-95e9-f8799daf020c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1408 microversion: 2.20 time: 0.216240 Aug 27 04:38:46.881329 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 411/819] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:38:46 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1408 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:38:47.734940 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-f7d09130-2bb9-4aa1-be48-ba4bd597c128 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:47.735628 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-f7d09130-2bb9-4aa1-be48-ba4bd597c128 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] [instance: a6d0e701-d87a-47cf-8d1a-a4244db04fe9] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:38:47.742184 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f7d09130-2bb9-4aa1-be48-ba4bd597c128 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:47.742719 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f7d09130-2bb9-4aa1-be48-ba4bd597c128 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:47.743521 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f7d09130-2bb9-4aa1-be48-ba4bd597c128 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:47.743956 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f7d09130-2bb9-4aa1-be48-ba4bd597c128 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:47.757315 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.wsgi [None req-f7d09130-2bb9-4aa1-be48-ba4bd597c128 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] HTTP exception thrown: Instance a6d0e701-d87a-47cf-8d1a-a4244db04fe9 could not be found. Aug 27 04:38:47.757925 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-f7d09130-2bb9-4aa1-be48-ba4bd597c128 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Returning 404 to user: Instance a6d0e701-d87a-47cf-8d1a-a4244db04fe9 could not be found. {{(pid=108970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:38:47.758743 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-f7d09130-2bb9-4aa1-be48-ba4bd597c128 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] 10.222.0.53 "GET /compute/v2.1/servers/a6d0e701-d87a-47cf-8d1a-a4244db04fe9" status: 404 len: 111 microversion: 2.1 time: 0.027932 Aug 27 04:38:47.759316 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 409/820] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:38:47 2021] GET /compute/v2.1/servers/a6d0e701-d87a-47cf-8d1a-a4244db04fe9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:38:47.904873 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-a3dc2e6f-7526-4203-962e-104eada3c2bf tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:47.904873 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-a3dc2e6f-7526-4203-962e-104eada3c2bf tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:38:47.911080 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a3dc2e6f-7526-4203-962e-104eada3c2bf tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:47.911743 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a3dc2e6f-7526-4203-962e-104eada3c2bf tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:47.912956 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a3dc2e6f-7526-4203-962e-104eada3c2bf tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:47.913251 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a3dc2e6f-7526-4203-962e-104eada3c2bf tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:48.039358 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-a3dc2e6f-7526-4203-962e-104eada3c2bf tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:48.047344 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-a3dc2e6f-7526-4203-962e-104eada3c2bf tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:48.048872 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-a3dc2e6f-7526-4203-962e-104eada3c2bf tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:48.049955 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-a3dc2e6f-7526-4203-962e-104eada3c2bf tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1408 microversion: 2.20 time: 0.155248 Aug 27 04:38:48.050512 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 412/821] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:38:47 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:38:49.067563 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-11bc9c2f-587f-4692-b7d3-8ae81d0118b0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:49.068186 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-11bc9c2f-587f-4692-b7d3-8ae81d0118b0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:38:49.074157 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-11bc9c2f-587f-4692-b7d3-8ae81d0118b0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:49.074599 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-11bc9c2f-587f-4692-b7d3-8ae81d0118b0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:49.075415 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-11bc9c2f-587f-4692-b7d3-8ae81d0118b0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:49.075844 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-11bc9c2f-587f-4692-b7d3-8ae81d0118b0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:49.202353 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-11bc9c2f-587f-4692-b7d3-8ae81d0118b0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:49.216648 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-11bc9c2f-587f-4692-b7d3-8ae81d0118b0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:49.218722 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-11bc9c2f-587f-4692-b7d3-8ae81d0118b0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:49.219831 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-11bc9c2f-587f-4692-b7d3-8ae81d0118b0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1408 microversion: 2.20 time: 0.156171 Aug 27 04:38:49.220471 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 410/822] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:38:49 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:38:50.238412 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-745dd905-6758-44fc-9f63-9ca38a8acfab tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:50.238992 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-745dd905-6758-44fc-9f63-9ca38a8acfab tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:38:50.244892 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-745dd905-6758-44fc-9f63-9ca38a8acfab tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:50.245336 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-745dd905-6758-44fc-9f63-9ca38a8acfab tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:50.246092 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-745dd905-6758-44fc-9f63-9ca38a8acfab tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:50.246525 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-745dd905-6758-44fc-9f63-9ca38a8acfab tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:50.364012 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-745dd905-6758-44fc-9f63-9ca38a8acfab tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:50.371852 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-745dd905-6758-44fc-9f63-9ca38a8acfab tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:50.373378 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-745dd905-6758-44fc-9f63-9ca38a8acfab tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:50.374451 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-745dd905-6758-44fc-9f63-9ca38a8acfab tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1408 microversion: 2.20 time: 0.140675 Aug 27 04:38:50.375009 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 413/823] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:38:50 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1408 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:38:51.392007 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-f76358a4-370a-4fa4-94cc-468ba6b26132 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:51.392616 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-f76358a4-370a-4fa4-94cc-468ba6b26132 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:38:51.398450 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f76358a4-370a-4fa4-94cc-468ba6b26132 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:51.398893 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f76358a4-370a-4fa4-94cc-468ba6b26132 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:51.399660 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f76358a4-370a-4fa4-94cc-468ba6b26132 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:51.400125 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f76358a4-370a-4fa4-94cc-468ba6b26132 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:51.521023 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-f76358a4-370a-4fa4-94cc-468ba6b26132 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:51.528715 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-f76358a4-370a-4fa4-94cc-468ba6b26132 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:51.530217 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-f76358a4-370a-4fa4-94cc-468ba6b26132 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:51.531287 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-f76358a4-370a-4fa4-94cc-468ba6b26132 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1408 microversion: 2.20 time: 0.143014 Aug 27 04:38:51.531838 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 411/824] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:38:51 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1408 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:38:52.550078 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-02365694-21ac-4a6b-b60f-99708537cea5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:52.550679 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-02365694-21ac-4a6b-b60f-99708537cea5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:38:52.556589 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-02365694-21ac-4a6b-b60f-99708537cea5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:52.557040 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-02365694-21ac-4a6b-b60f-99708537cea5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:52.557801 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-02365694-21ac-4a6b-b60f-99708537cea5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:52.558237 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-02365694-21ac-4a6b-b60f-99708537cea5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:52.680952 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-02365694-21ac-4a6b-b60f-99708537cea5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:52.688585 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-02365694-21ac-4a6b-b60f-99708537cea5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:52.690147 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-02365694-21ac-4a6b-b60f-99708537cea5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:52.691273 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-02365694-21ac-4a6b-b60f-99708537cea5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1408 microversion: 2.20 time: 0.145461 Aug 27 04:38:52.691830 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 414/825] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:38:52 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1408 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:38:53.708959 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-3fef2494-20f4-428d-9c8e-fe904dcbf42e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:53.709505 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-3fef2494-20f4-428d-9c8e-fe904dcbf42e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:38:53.715382 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3fef2494-20f4-428d-9c8e-fe904dcbf42e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:53.715837 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3fef2494-20f4-428d-9c8e-fe904dcbf42e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:53.716645 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3fef2494-20f4-428d-9c8e-fe904dcbf42e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:53.717085 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3fef2494-20f4-428d-9c8e-fe904dcbf42e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:53.835101 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-3fef2494-20f4-428d-9c8e-fe904dcbf42e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:53.843664 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-3fef2494-20f4-428d-9c8e-fe904dcbf42e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:53.845208 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-3fef2494-20f4-428d-9c8e-fe904dcbf42e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:53.846294 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-3fef2494-20f4-428d-9c8e-fe904dcbf42e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1408 microversion: 2.20 time: 0.141132 Aug 27 04:38:53.847424 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 412/826] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:38:53 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1408 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:38:54.864678 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-909fd0ea-35e2-41e7-8836-9117325f7a87 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:54.865289 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-909fd0ea-35e2-41e7-8836-9117325f7a87 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:38:54.871189 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-909fd0ea-35e2-41e7-8836-9117325f7a87 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:54.871642 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-909fd0ea-35e2-41e7-8836-9117325f7a87 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:54.872429 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-909fd0ea-35e2-41e7-8836-9117325f7a87 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:54.872944 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-909fd0ea-35e2-41e7-8836-9117325f7a87 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:54.990477 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-909fd0ea-35e2-41e7-8836-9117325f7a87 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:54.998136 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-909fd0ea-35e2-41e7-8836-9117325f7a87 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:54.999639 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-909fd0ea-35e2-41e7-8836-9117325f7a87 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:55.000761 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-909fd0ea-35e2-41e7-8836-9117325f7a87 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1408 microversion: 2.20 time: 0.139831 Aug 27 04:38:55.001312 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 415/827] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:38:54 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1408 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:38:56.018249 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-692e24b6-ef73-4310-ad7a-336de7fe4aeb tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:56.018890 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-692e24b6-ef73-4310-ad7a-336de7fe4aeb tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:38:56.024799 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-692e24b6-ef73-4310-ad7a-336de7fe4aeb tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:56.025251 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-692e24b6-ef73-4310-ad7a-336de7fe4aeb tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:56.026017 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-692e24b6-ef73-4310-ad7a-336de7fe4aeb tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:56.026456 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-692e24b6-ef73-4310-ad7a-336de7fe4aeb tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:56.141956 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-692e24b6-ef73-4310-ad7a-336de7fe4aeb tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:56.149585 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-692e24b6-ef73-4310-ad7a-336de7fe4aeb tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:56.151088 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-692e24b6-ef73-4310-ad7a-336de7fe4aeb tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:56.152196 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-692e24b6-ef73-4310-ad7a-336de7fe4aeb tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1408 microversion: 2.20 time: 0.137666 Aug 27 04:38:56.152750 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 413/828] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:38:56 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1408 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:38:57.170315 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-226e738c-a0b2-40b5-883a-30e6499722ce tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:57.170871 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-226e738c-a0b2-40b5-883a-30e6499722ce tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:38:57.177183 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-226e738c-a0b2-40b5-883a-30e6499722ce tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:57.177620 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-226e738c-a0b2-40b5-883a-30e6499722ce tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:57.178368 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-226e738c-a0b2-40b5-883a-30e6499722ce tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:57.178794 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-226e738c-a0b2-40b5-883a-30e6499722ce tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:57.303219 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-226e738c-a0b2-40b5-883a-30e6499722ce tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:57.310896 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-226e738c-a0b2-40b5-883a-30e6499722ce tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:57.312417 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-226e738c-a0b2-40b5-883a-30e6499722ce tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:57.313605 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-226e738c-a0b2-40b5-883a-30e6499722ce tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1408 microversion: 2.20 time: 0.147033 Aug 27 04:38:57.314179 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 416/829] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:38:57 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1408 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:38:58.330511 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-2c18c2b6-b20b-4f8f-98f8-3d5091cf3071 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:58.331118 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-2c18c2b6-b20b-4f8f-98f8-3d5091cf3071 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:38:58.337654 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2c18c2b6-b20b-4f8f-98f8-3d5091cf3071 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:58.338099 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2c18c2b6-b20b-4f8f-98f8-3d5091cf3071 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:58.338855 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2c18c2b6-b20b-4f8f-98f8-3d5091cf3071 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:58.339286 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2c18c2b6-b20b-4f8f-98f8-3d5091cf3071 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:58.461495 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-2c18c2b6-b20b-4f8f-98f8-3d5091cf3071 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:58.469105 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-2c18c2b6-b20b-4f8f-98f8-3d5091cf3071 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:58.470589 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-2c18c2b6-b20b-4f8f-98f8-3d5091cf3071 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:58.471653 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-2c18c2b6-b20b-4f8f-98f8-3d5091cf3071 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1408 microversion: 2.20 time: 0.144901 Aug 27 04:38:58.472250 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 414/830] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:38:58 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1408 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:38:59.490960 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-ea63f49a-5ca7-422a-b430-90f8c3eefca8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:38:59.491575 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-ea63f49a-5ca7-422a-b430-90f8c3eefca8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:38:59.497409 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ea63f49a-5ca7-422a-b430-90f8c3eefca8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:59.497857 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ea63f49a-5ca7-422a-b430-90f8c3eefca8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:59.498623 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ea63f49a-5ca7-422a-b430-90f8c3eefca8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:38:59.499060 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ea63f49a-5ca7-422a-b430-90f8c3eefca8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:38:59.620687 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-ea63f49a-5ca7-422a-b430-90f8c3eefca8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:59.628432 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-ea63f49a-5ca7-422a-b430-90f8c3eefca8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:59.630445 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-ea63f49a-5ca7-422a-b430-90f8c3eefca8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:38:59.631584 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-ea63f49a-5ca7-422a-b430-90f8c3eefca8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1408 microversion: 2.20 time: 0.144820 Aug 27 04:38:59.632448 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 417/831] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:38:59 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1408 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:39:00.649318 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-88152248-cf8d-4a98-93fd-3900ee430d04 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:00.649857 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-88152248-cf8d-4a98-93fd-3900ee430d04 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:00.655684 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-88152248-cf8d-4a98-93fd-3900ee430d04 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:00.656171 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-88152248-cf8d-4a98-93fd-3900ee430d04 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:00.656944 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-88152248-cf8d-4a98-93fd-3900ee430d04 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:00.657379 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-88152248-cf8d-4a98-93fd-3900ee430d04 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:00.775674 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-88152248-cf8d-4a98-93fd-3900ee430d04 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:00.783397 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-88152248-cf8d-4a98-93fd-3900ee430d04 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:00.785552 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-88152248-cf8d-4a98-93fd-3900ee430d04 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:00.786642 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-88152248-cf8d-4a98-93fd-3900ee430d04 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1408 microversion: 2.20 time: 0.141188 Aug 27 04:39:00.787204 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 415/832] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:39:00 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1408 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:39:01.633534 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-834fb778-9486-481b-bbb2-7a001e56caa1 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-141996407", "imageRef": "9356e2fa-e55b-41d9-9ca4-53393f2d79fd", "flavorRef": "452", "networks": [{"uuid": "2c4a6e7e-9097-4463-a2f9-98b692a514cf"}]}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:01.687382 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.network.neutron [None req-834fb778-9486-481b-bbb2-7a001e56caa1 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] validate_networks() for [('2c4a6e7e-9097-4463-a2f9-98b692a514cf', None, None, None, None, None)] {{(pid=108971) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 04:39:01.804768 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-f644a370-a316-4af9-9637-daa661197aaa tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:01.805374 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-f644a370-a316-4af9-9637-daa661197aaa tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:01.811122 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f644a370-a316-4af9-9637-daa661197aaa tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:01.811570 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f644a370-a316-4af9-9637-daa661197aaa tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:01.812367 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f644a370-a316-4af9-9637-daa661197aaa tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:01.812802 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f644a370-a316-4af9-9637-daa661197aaa tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:01.934124 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-f644a370-a316-4af9-9637-daa661197aaa tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:01.942063 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-f644a370-a316-4af9-9637-daa661197aaa tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:01.943583 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-f644a370-a316-4af9-9637-daa661197aaa tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:01.944723 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-f644a370-a316-4af9-9637-daa661197aaa tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1408 microversion: 2.20 time: 0.144314 Aug 27 04:39:01.945285 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 416/833] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:39:01 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1408 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:39:02.025672 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.virt.hardware [None req-834fb778-9486-481b-bbb2-7a001e56caa1 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Flavor limits 0:0:0 {{(pid=108971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:39:02.026091 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.virt.hardware [None req-834fb778-9486-481b-bbb2-7a001e56caa1 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Image limits 0:0:0 {{(pid=108971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:39:02.026563 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.virt.hardware [None req-834fb778-9486-481b-bbb2-7a001e56caa1 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Flavor pref 0:0:0 {{(pid=108971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:39:02.026969 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.virt.hardware [None req-834fb778-9486-481b-bbb2-7a001e56caa1 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Image pref 0:0:0 {{(pid=108971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:39:02.027378 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.virt.hardware [None req-834fb778-9486-481b-bbb2-7a001e56caa1 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:39:02.036566 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-834fb778-9486-481b-bbb2-7a001e56caa1 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:02.037015 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-834fb778-9486-481b-bbb2-7a001e56caa1 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:02.037814 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-834fb778-9486-481b-bbb2-7a001e56caa1 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:02.038250 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-834fb778-9486-481b-bbb2-7a001e56caa1 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:02.057566 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.quota [None req-834fb778-9486-481b-bbb2-7a001e56caa1 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Getting quotas for project ecbf39b95058423f95015e37925d1a8d. Resources: {'ram', 'cores', 'instances'} {{(pid=108971) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:39:02.061798 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.quota [None req-834fb778-9486-481b-bbb2-7a001e56caa1 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Getting quotas for user 175c169d2bfb4f0f89e2fdfe8485c999 and project ecbf39b95058423f95015e37925d1a8d. Resources: {'ram', 'cores', 'instances'} {{(pid=108971) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:39:02.072723 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-834fb778-9486-481b-bbb2-7a001e56caa1 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Going to run 1 instances... {{(pid=108971) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 04:39:02.075020 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-834fb778-9486-481b-bbb2-7a001e56caa1 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] [instance: cbccf205-2ebe-408e-8562-aad32ed0f52c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9356e2fa-e55b-41d9-9ca4-53393f2d79fd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 04:39:02.123711 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-834fb778-9486-481b-bbb2-7a001e56caa1 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] 10.222.0.53 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.493933 Aug 27 04:39:02.124599 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 418/834] 10.222.0.53 () {60 vars in 1147 bytes} [Fri Aug 27 04:39:01 2021] POST /compute/v2.1/servers => generated 380 bytes in 496 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 04:39:02.134700 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-a6290f82-42a8-4d1f-bff6-54cdb39cd40b tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:02.135330 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-a6290f82-42a8-4d1f-bff6-54cdb39cd40b tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] [instance: cbccf205-2ebe-408e-8562-aad32ed0f52c] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:02.185590 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-a6290f82-42a8-4d1f-bff6-54cdb39cd40b tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175c169d2bfb4f0f89e2fdfe8485c999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbf39b95058423f95015e37925d1a8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:02.192018 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-a6290f82-42a8-4d1f-bff6-54cdb39cd40b tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] 10.222.0.53 "GET /compute/v2.1/servers/cbccf205-2ebe-408e-8562-aad32ed0f52c" status: 200 len: 1218 microversion: 2.1 time: 0.061025 Aug 27 04:39:02.192619 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 417/835] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:39:02 2021] GET /compute/v2.1/servers/cbccf205-2ebe-408e-8562-aad32ed0f52c => generated 1218 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:02.962065 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-89dde49a-7c26-4ab4-93cc-9318c3fdca62 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:02.962676 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-89dde49a-7c26-4ab4-93cc-9318c3fdca62 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:02.968699 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-89dde49a-7c26-4ab4-93cc-9318c3fdca62 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:02.969319 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-89dde49a-7c26-4ab4-93cc-9318c3fdca62 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:02.970098 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-89dde49a-7c26-4ab4-93cc-9318c3fdca62 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:02.970542 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-89dde49a-7c26-4ab4-93cc-9318c3fdca62 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:03.095283 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-89dde49a-7c26-4ab4-93cc-9318c3fdca62 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:03.103522 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-89dde49a-7c26-4ab4-93cc-9318c3fdca62 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:03.105066 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-89dde49a-7c26-4ab4-93cc-9318c3fdca62 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:03.106185 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-89dde49a-7c26-4ab4-93cc-9318c3fdca62 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1408 microversion: 2.20 time: 0.147856 Aug 27 04:39:03.106741 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 419/836] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:39:02 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1408 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:39:03.209226 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-69a7eb54-70bb-4133-bb08-c200d8947805 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:03.209849 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-69a7eb54-70bb-4133-bb08-c200d8947805 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] [instance: cbccf205-2ebe-408e-8562-aad32ed0f52c] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:03.216169 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-69a7eb54-70bb-4133-bb08-c200d8947805 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:03.216501 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-69a7eb54-70bb-4133-bb08-c200d8947805 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:03.217461 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-69a7eb54-70bb-4133-bb08-c200d8947805 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:03.217901 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-69a7eb54-70bb-4133-bb08-c200d8947805 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:03.281923 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-69a7eb54-70bb-4133-bb08-c200d8947805 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175c169d2bfb4f0f89e2fdfe8485c999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbf39b95058423f95015e37925d1a8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:03.291963 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-69a7eb54-70bb-4133-bb08-c200d8947805 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] 10.222.0.53 "GET /compute/v2.1/servers/cbccf205-2ebe-408e-8562-aad32ed0f52c" status: 200 len: 1276 microversion: 2.1 time: 0.086560 Aug 27 04:39:03.301100 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 418/837] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:39:03 2021] GET /compute/v2.1/servers/cbccf205-2ebe-408e-8562-aad32ed0f52c => generated 1276 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:39:04.124408 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-75479307-c4a4-481d-b044-f09127494fee tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:04.125134 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-75479307-c4a4-481d-b044-f09127494fee tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:04.132810 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-75479307-c4a4-481d-b044-f09127494fee tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:04.133283 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-75479307-c4a4-481d-b044-f09127494fee tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:04.134394 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-75479307-c4a4-481d-b044-f09127494fee tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:04.134973 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-75479307-c4a4-481d-b044-f09127494fee tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:04.309743 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-18d15186-30e9-48c1-a839-787dd9d27653 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:04.310550 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-18d15186-30e9-48c1-a839-787dd9d27653 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] [instance: cbccf205-2ebe-408e-8562-aad32ed0f52c] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:04.316382 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-18d15186-30e9-48c1-a839-787dd9d27653 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:04.316919 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-18d15186-30e9-48c1-a839-787dd9d27653 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:04.317784 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-18d15186-30e9-48c1-a839-787dd9d27653 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:04.318296 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-18d15186-30e9-48c1-a839-787dd9d27653 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:04.357058 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-75479307-c4a4-481d-b044-f09127494fee tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:04.380583 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-75479307-c4a4-481d-b044-f09127494fee tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:04.382239 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-75479307-c4a4-481d-b044-f09127494fee tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:04.383355 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-75479307-c4a4-481d-b044-f09127494fee tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1408 microversion: 2.20 time: 0.262613 Aug 27 04:39:04.384145 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 420/838] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:39:04 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1408 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:39:04.466324 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-18d15186-30e9-48c1-a839-787dd9d27653 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175c169d2bfb4f0f89e2fdfe8485c999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbf39b95058423f95015e37925d1a8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:04.475899 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-18d15186-30e9-48c1-a839-787dd9d27653 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] 10.222.0.53 "GET /compute/v2.1/servers/cbccf205-2ebe-408e-8562-aad32ed0f52c" status: 200 len: 1318 microversion: 2.1 time: 0.169725 Aug 27 04:39:04.476546 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 419/839] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:39:04 2021] GET /compute/v2.1/servers/cbccf205-2ebe-408e-8562-aad32ed0f52c => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:39:04.491556 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [req-ab453b93-fb36-4315-b9f0-be0ce64084b8 req-909536c4-08df-4879-b4db-7e9c67810225 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbccf205-2ebe-408e-8562-aad32ed0f52c", "tag": "2059b96a-970e-44aa-95b2-28f50884a53e"}]} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:04.493687 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:39:04.493687 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: warnings.warn(msg) Aug 27 04:39:04.501198 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-ab453b93-fb36-4315-b9f0-be0ce64084b8 req-909536c4-08df-4879-b4db-7e9c67810225 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:04.502003 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-ab453b93-fb36-4315-b9f0-be0ce64084b8 req-909536c4-08df-4879-b4db-7e9c67810225 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:04.521532 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.compute.server_external_events [req-ab453b93-fb36-4315-b9f0-be0ce64084b8 req-909536c4-08df-4879-b4db-7e9c67810225 service nova] Creating event network-changed:2059b96a-970e-44aa-95b2-28f50884a53e for instance cbccf205-2ebe-408e-8562-aad32ed0f52c on hv-cinder-80403 Aug 27 04:39:04.526687 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [req-ab453b93-fb36-4315-b9f0-be0ce64084b8 req-909536c4-08df-4879-b4db-7e9c67810225 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039276 Aug 27 04:39:04.527380 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 421/840] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:39:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:39:04.646493 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [req-5799ecaa-2d0a-4de4-92b0-7a01723bf0ee req-8a278e9d-9f9c-4d06-8f62-7f8117ac9fc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bbb8317-81d9-4e49-bd0b-32a4446ec505", "name": "network-vif-plugged", "status": "completed", "tag": "792a8fdf-832a-4455-8433-eb97d588eb8e"}]} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:04.648338 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:39:04.648338 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: warnings.warn(msg) Aug 27 04:39:04.657321 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-5799ecaa-2d0a-4de4-92b0-7a01723bf0ee req-8a278e9d-9f9c-4d06-8f62-7f8117ac9fc9 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:04.657872 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-5799ecaa-2d0a-4de4-92b0-7a01723bf0ee req-8a278e9d-9f9c-4d06-8f62-7f8117ac9fc9 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:04.669975 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.compute.server_external_events [req-5799ecaa-2d0a-4de4-92b0-7a01723bf0ee req-8a278e9d-9f9c-4d06-8f62-7f8117ac9fc9 service nova] Creating event network-vif-plugged:792a8fdf-832a-4455-8433-eb97d588eb8e for instance 4bbb8317-81d9-4e49-bd0b-32a4446ec505 on hv-cinder-80403 Aug 27 04:39:04.675724 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [req-5799ecaa-2d0a-4de4-92b0-7a01723bf0ee req-8a278e9d-9f9c-4d06-8f62-7f8117ac9fc9 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032358 Aug 27 04:39:04.676677 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 420/841] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:39:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:39:05.402981 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-a0fa5f98-e47f-4c64-bdd0-95cbd280c184 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:05.403672 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-a0fa5f98-e47f-4c64-bdd0-95cbd280c184 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:05.410361 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a0fa5f98-e47f-4c64-bdd0-95cbd280c184 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:05.410833 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a0fa5f98-e47f-4c64-bdd0-95cbd280c184 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:05.411592 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a0fa5f98-e47f-4c64-bdd0-95cbd280c184 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:05.412040 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a0fa5f98-e47f-4c64-bdd0-95cbd280c184 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:05.493723 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-1071b3d4-fb04-475a-879d-ba6c818968d2 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:05.494527 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-1071b3d4-fb04-475a-879d-ba6c818968d2 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] [instance: cbccf205-2ebe-408e-8562-aad32ed0f52c] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:05.500593 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1071b3d4-fb04-475a-879d-ba6c818968d2 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:05.501060 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1071b3d4-fb04-475a-879d-ba6c818968d2 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:05.501801 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1071b3d4-fb04-475a-879d-ba6c818968d2 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:05.502234 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1071b3d4-fb04-475a-879d-ba6c818968d2 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:05.534374 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-a0fa5f98-e47f-4c64-bdd0-95cbd280c184 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:05.542862 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-a0fa5f98-e47f-4c64-bdd0-95cbd280c184 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:05.544370 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-a0fa5f98-e47f-4c64-bdd0-95cbd280c184 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:05.545447 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-a0fa5f98-e47f-4c64-bdd0-95cbd280c184 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1408 microversion: 2.20 time: 0.146513 Aug 27 04:39:05.546013 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 422/842] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:39:05 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1408 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:39:05.627260 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-1071b3d4-fb04-475a-879d-ba6c818968d2 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175c169d2bfb4f0f89e2fdfe8485c999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbf39b95058423f95015e37925d1a8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:05.634965 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-1071b3d4-fb04-475a-879d-ba6c818968d2 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] 10.222.0.53 "GET /compute/v2.1/servers/cbccf205-2ebe-408e-8562-aad32ed0f52c" status: 200 len: 1318 microversion: 2.1 time: 0.145599 Aug 27 04:39:05.635585 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 421/843] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:39:05 2021] GET /compute/v2.1/servers/cbccf205-2ebe-408e-8562-aad32ed0f52c => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:39:06.562882 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-92e037af-916e-4967-88b4-02860eced401 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:06.563482 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-92e037af-916e-4967-88b4-02860eced401 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:06.569314 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-92e037af-916e-4967-88b4-02860eced401 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:06.569725 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-92e037af-916e-4967-88b4-02860eced401 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:06.570481 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-92e037af-916e-4967-88b4-02860eced401 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:06.570916 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-92e037af-916e-4967-88b4-02860eced401 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:06.653393 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-4afbba71-5e14-4619-864b-2d7f8c6c9b2d tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:06.654010 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-4afbba71-5e14-4619-864b-2d7f8c6c9b2d tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] [instance: cbccf205-2ebe-408e-8562-aad32ed0f52c] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:06.659812 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4afbba71-5e14-4619-864b-2d7f8c6c9b2d tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:06.660293 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4afbba71-5e14-4619-864b-2d7f8c6c9b2d tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:06.661637 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4afbba71-5e14-4619-864b-2d7f8c6c9b2d tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:06.662080 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4afbba71-5e14-4619-864b-2d7f8c6c9b2d tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:06.693682 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-92e037af-916e-4967-88b4-02860eced401 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:06.701550 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-92e037af-916e-4967-88b4-02860eced401 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:06.703150 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-92e037af-916e-4967-88b4-02860eced401 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:06.704341 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-92e037af-916e-4967-88b4-02860eced401 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1408 microversion: 2.20 time: 0.145172 Aug 27 04:39:06.704998 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 423/844] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:39:06 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1408 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:39:06.780157 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-4afbba71-5e14-4619-864b-2d7f8c6c9b2d tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175c169d2bfb4f0f89e2fdfe8485c999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbf39b95058423f95015e37925d1a8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:06.787854 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-4afbba71-5e14-4619-864b-2d7f8c6c9b2d tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] 10.222.0.53 "GET /compute/v2.1/servers/cbccf205-2ebe-408e-8562-aad32ed0f52c" status: 200 len: 1318 microversion: 2.1 time: 0.138145 Aug 27 04:39:06.788438 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 422/845] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:39:06 2021] GET /compute/v2.1/servers/cbccf205-2ebe-408e-8562-aad32ed0f52c => generated 1318 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:39:07.722770 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-f61b736d-5339-466e-b90a-f90637f4f992 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:07.723309 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-f61b736d-5339-466e-b90a-f90637f4f992 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:07.730347 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f61b736d-5339-466e-b90a-f90637f4f992 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:07.730797 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f61b736d-5339-466e-b90a-f90637f4f992 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:07.731574 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f61b736d-5339-466e-b90a-f90637f4f992 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:07.732026 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f61b736d-5339-466e-b90a-f90637f4f992 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:07.805384 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-8e4f7ecc-13c1-43ab-942d-55dd182af7e6 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:07.806032 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-8e4f7ecc-13c1-43ab-942d-55dd182af7e6 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] [instance: cbccf205-2ebe-408e-8562-aad32ed0f52c] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:07.812153 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-8e4f7ecc-13c1-43ab-942d-55dd182af7e6 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:07.812832 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-8e4f7ecc-13c1-43ab-942d-55dd182af7e6 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:07.813605 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-8e4f7ecc-13c1-43ab-942d-55dd182af7e6 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:07.814036 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-8e4f7ecc-13c1-43ab-942d-55dd182af7e6 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:07.855547 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-f61b736d-5339-466e-b90a-f90637f4f992 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:07.864477 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-f61b736d-5339-466e-b90a-f90637f4f992 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:07.865977 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-f61b736d-5339-466e-b90a-f90637f4f992 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:07.867110 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-f61b736d-5339-466e-b90a-f90637f4f992 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1601 microversion: 2.20 time: 0.148324 Aug 27 04:39:07.867669 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 424/846] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:39:07 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1601 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:39:07.883819 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-77ccc7d4-11e7-4635-ab8d-1391e7b08536 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:07.884605 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-77ccc7d4-11e7-4635-ab8d-1391e7b08536 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:07.890667 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-77ccc7d4-11e7-4635-ab8d-1391e7b08536 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:07.891117 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-77ccc7d4-11e7-4635-ab8d-1391e7b08536 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:07.891887 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-77ccc7d4-11e7-4635-ab8d-1391e7b08536 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:07.892350 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-77ccc7d4-11e7-4635-ab8d-1391e7b08536 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:07.937723 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-8e4f7ecc-13c1-43ab-942d-55dd182af7e6 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175c169d2bfb4f0f89e2fdfe8485c999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbf39b95058423f95015e37925d1a8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:07.945246 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-8e4f7ecc-13c1-43ab-942d-55dd182af7e6 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] 10.222.0.53 "GET /compute/v2.1/servers/cbccf205-2ebe-408e-8562-aad32ed0f52c" status: 200 len: 1318 microversion: 2.1 time: 0.144236 Aug 27 04:39:07.955367 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 423/847] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:39:07 2021] GET /compute/v2.1/servers/cbccf205-2ebe-408e-8562-aad32ed0f52c => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:39:07.975638 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-77ccc7d4-11e7-4635-ab8d-1391e7b08536 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.095395 Aug 27 04:39:07.976321 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 425/848] 10.222.0.53 () {60 vars in 1316 bytes} [Fri Aug 27 04:39:07 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:39:08.963009 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-17aa4c2c-d692-4be9-8220-293c6fbc3e2a tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:08.963548 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-17aa4c2c-d692-4be9-8220-293c6fbc3e2a tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] [instance: cbccf205-2ebe-408e-8562-aad32ed0f52c] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:08.969349 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-17aa4c2c-d692-4be9-8220-293c6fbc3e2a tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:08.969803 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-17aa4c2c-d692-4be9-8220-293c6fbc3e2a tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:08.970570 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-17aa4c2c-d692-4be9-8220-293c6fbc3e2a tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:08.971031 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-17aa4c2c-d692-4be9-8220-293c6fbc3e2a tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:09.042502 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-d858a0af-854e-4643-a362-9dc14fcc9cfa tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:09.044538 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-d858a0af-854e-4643-a362-9dc14fcc9cfa tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:09.050911 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d858a0af-854e-4643-a362-9dc14fcc9cfa tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:09.051663 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d858a0af-854e-4643-a362-9dc14fcc9cfa tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:09.053030 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d858a0af-854e-4643-a362-9dc14fcc9cfa tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:09.053881 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d858a0af-854e-4643-a362-9dc14fcc9cfa tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:09.104561 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-17aa4c2c-d692-4be9-8220-293c6fbc3e2a tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175c169d2bfb4f0f89e2fdfe8485c999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbf39b95058423f95015e37925d1a8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:09.112224 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-17aa4c2c-d692-4be9-8220-293c6fbc3e2a tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] 10.222.0.53 "GET /compute/v2.1/servers/cbccf205-2ebe-408e-8562-aad32ed0f52c" status: 200 len: 1318 microversion: 2.1 time: 0.152975 Aug 27 04:39:09.112801 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 424/849] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:39:08 2021] GET /compute/v2.1/servers/cbccf205-2ebe-408e-8562-aad32ed0f52c => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:09.118325 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [req-21a78532-e5e8-41f6-9e73-ae4ba45367e8 req-d2a794f8-99ac-472a-a732-88cec1ef9e81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bbb8317-81d9-4e49-bd0b-32a4446ec505", "tag": "792a8fdf-832a-4455-8433-eb97d588eb8e"}]} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:09.119883 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:39:09.119883 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: warnings.warn(msg) Aug 27 04:39:09.128231 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-21a78532-e5e8-41f6-9e73-ae4ba45367e8 req-d2a794f8-99ac-472a-a732-88cec1ef9e81 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:09.128853 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-21a78532-e5e8-41f6-9e73-ae4ba45367e8 req-d2a794f8-99ac-472a-a732-88cec1ef9e81 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:09.143377 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.compute.server_external_events [req-21a78532-e5e8-41f6-9e73-ae4ba45367e8 req-d2a794f8-99ac-472a-a732-88cec1ef9e81 service nova] Creating event network-changed:792a8fdf-832a-4455-8433-eb97d588eb8e for instance 4bbb8317-81d9-4e49-bd0b-32a4446ec505 on hv-cinder-80403 Aug 27 04:39:09.149770 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [req-21a78532-e5e8-41f6-9e73-ae4ba45367e8 req-d2a794f8-99ac-472a-a732-88cec1ef9e81 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034853 Aug 27 04:39:09.150382 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 425/850] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:39:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:39:09.161566 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-d858a0af-854e-4643-a362-9dc14fcc9cfa tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 14 microversion: 2.20 time: 0.123359 Aug 27 04:39:09.162201 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 426/851] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:39:09 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:10.130457 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-85627c11-ede6-4315-9d9c-c2e62e11ddd9 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:10.131229 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-85627c11-ede6-4315-9d9c-c2e62e11ddd9 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] [instance: cbccf205-2ebe-408e-8562-aad32ed0f52c] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:10.137682 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-85627c11-ede6-4315-9d9c-c2e62e11ddd9 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:10.138397 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-85627c11-ede6-4315-9d9c-c2e62e11ddd9 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:10.139204 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-85627c11-ede6-4315-9d9c-c2e62e11ddd9 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:10.139646 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-85627c11-ede6-4315-9d9c-c2e62e11ddd9 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:10.173103 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-c531ecfd-ff79-425d-8957-6cfc92b20cae tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:10.174212 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-c531ecfd-ff79-425d-8957-6cfc92b20cae tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:10.182439 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c531ecfd-ff79-425d-8957-6cfc92b20cae tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:10.182911 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c531ecfd-ff79-425d-8957-6cfc92b20cae tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:10.183692 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c531ecfd-ff79-425d-8957-6cfc92b20cae tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:10.184157 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c531ecfd-ff79-425d-8957-6cfc92b20cae tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:10.272265 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-85627c11-ede6-4315-9d9c-c2e62e11ddd9 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175c169d2bfb4f0f89e2fdfe8485c999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbf39b95058423f95015e37925d1a8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:10.272425 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-c531ecfd-ff79-425d-8957-6cfc92b20cae tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 14 microversion: 2.20 time: 0.103221 Aug 27 04:39:10.272941 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 427/852] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:39:10 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:39:10.279566 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-85627c11-ede6-4315-9d9c-c2e62e11ddd9 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] 10.222.0.53 "GET /compute/v2.1/servers/cbccf205-2ebe-408e-8562-aad32ed0f52c" status: 200 len: 1318 microversion: 2.1 time: 0.153740 Aug 27 04:39:10.280154 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 426/853] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:39:10 2021] GET /compute/v2.1/servers/cbccf205-2ebe-408e-8562-aad32ed0f52c => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:11.283096 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-f20738cf-a3a2-4ffa-9197-92d74608ef84 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:11.284104 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-f20738cf-a3a2-4ffa-9197-92d74608ef84 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:11.291124 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f20738cf-a3a2-4ffa-9197-92d74608ef84 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:11.291545 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f20738cf-a3a2-4ffa-9197-92d74608ef84 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:11.292330 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f20738cf-a3a2-4ffa-9197-92d74608ef84 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:11.292756 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f20738cf-a3a2-4ffa-9197-92d74608ef84 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:11.296479 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-80b23705-fc8f-49f2-9f44-e29161e62dc1 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:11.297031 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-80b23705-fc8f-49f2-9f44-e29161e62dc1 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] [instance: cbccf205-2ebe-408e-8562-aad32ed0f52c] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:11.302733 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-80b23705-fc8f-49f2-9f44-e29161e62dc1 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:11.303211 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-80b23705-fc8f-49f2-9f44-e29161e62dc1 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:11.303958 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-80b23705-fc8f-49f2-9f44-e29161e62dc1 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:11.304419 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-80b23705-fc8f-49f2-9f44-e29161e62dc1 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:11.381601 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-f20738cf-a3a2-4ffa-9197-92d74608ef84 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 14 microversion: 2.20 time: 0.102347 Aug 27 04:39:11.384703 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 428/854] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:39:11 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:11.428114 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-80b23705-fc8f-49f2-9f44-e29161e62dc1 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175c169d2bfb4f0f89e2fdfe8485c999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbf39b95058423f95015e37925d1a8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:11.435263 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-80b23705-fc8f-49f2-9f44-e29161e62dc1 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] 10.222.0.53 "GET /compute/v2.1/servers/cbccf205-2ebe-408e-8562-aad32ed0f52c" status: 200 len: 1318 microversion: 2.1 time: 0.142476 Aug 27 04:39:11.435826 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 427/855] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:39:11 2021] GET /compute/v2.1/servers/cbccf205-2ebe-408e-8562-aad32ed0f52c => generated 1318 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:12.392317 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-c28b2460-3c03-4caa-8baf-21c8e931011a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:12.393313 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-c28b2460-3c03-4caa-8baf-21c8e931011a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:12.399801 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c28b2460-3c03-4caa-8baf-21c8e931011a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:12.400285 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c28b2460-3c03-4caa-8baf-21c8e931011a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:12.401056 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c28b2460-3c03-4caa-8baf-21c8e931011a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:12.401492 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c28b2460-3c03-4caa-8baf-21c8e931011a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:12.452509 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-fb08d5e3-e4ab-472b-806c-6c2022693487 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:12.453134 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-fb08d5e3-e4ab-472b-806c-6c2022693487 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] [instance: cbccf205-2ebe-408e-8562-aad32ed0f52c] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:12.458971 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fb08d5e3-e4ab-472b-806c-6c2022693487 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:12.459482 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fb08d5e3-e4ab-472b-806c-6c2022693487 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:12.460284 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fb08d5e3-e4ab-472b-806c-6c2022693487 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:12.460726 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fb08d5e3-e4ab-472b-806c-6c2022693487 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:12.485325 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-c28b2460-3c03-4caa-8baf-21c8e931011a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 14 microversion: 2.20 time: 0.097020 Aug 27 04:39:12.488368 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 429/856] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:39:12 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:39:12.572014 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [req-36c973e0-802b-49e6-97a4-8eaeca82f521 req-b2cc90e5-3735-4f75-b23a-75c35fe0854f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbccf205-2ebe-408e-8562-aad32ed0f52c", "name": "network-vif-plugged", "status": "completed", "tag": "2059b96a-970e-44aa-95b2-28f50884a53e"}]} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:12.573510 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:39:12.573510 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: warnings.warn(msg) Aug 27 04:39:12.581886 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-fb08d5e3-e4ab-472b-806c-6c2022693487 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175c169d2bfb4f0f89e2fdfe8485c999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbf39b95058423f95015e37925d1a8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:12.582626 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-36c973e0-802b-49e6-97a4-8eaeca82f521 req-b2cc90e5-3735-4f75-b23a-75c35fe0854f service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:12.583072 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-36c973e0-802b-49e6-97a4-8eaeca82f521 req-b2cc90e5-3735-4f75-b23a-75c35fe0854f service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:12.589795 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-fb08d5e3-e4ab-472b-806c-6c2022693487 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] 10.222.0.53 "GET /compute/v2.1/servers/cbccf205-2ebe-408e-8562-aad32ed0f52c" status: 200 len: 1318 microversion: 2.1 time: 0.141034 Aug 27 04:39:12.590363 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 428/857] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:39:12 2021] GET /compute/v2.1/servers/cbccf205-2ebe-408e-8562-aad32ed0f52c => generated 1318 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:39:12.599813 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.compute.server_external_events [req-36c973e0-802b-49e6-97a4-8eaeca82f521 req-b2cc90e5-3735-4f75-b23a-75c35fe0854f service nova] Creating event network-vif-plugged:2059b96a-970e-44aa-95b2-28f50884a53e for instance cbccf205-2ebe-408e-8562-aad32ed0f52c on hv-cinder-80403 Aug 27 04:39:12.601957 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [req-36c973e0-802b-49e6-97a4-8eaeca82f521 req-b2cc90e5-3735-4f75-b23a-75c35fe0854f service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034146 Aug 27 04:39:12.602628 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 430/858] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:39:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:39:13.496854 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-42b470fc-4342-4afe-b9cb-efd0bd814a1a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:13.497795 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-42b470fc-4342-4afe-b9cb-efd0bd814a1a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:13.503718 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-42b470fc-4342-4afe-b9cb-efd0bd814a1a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:13.504800 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-42b470fc-4342-4afe-b9cb-efd0bd814a1a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:13.505547 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-42b470fc-4342-4afe-b9cb-efd0bd814a1a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:13.505975 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-42b470fc-4342-4afe-b9cb-efd0bd814a1a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:13.595456 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-42b470fc-4342-4afe-b9cb-efd0bd814a1a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 14 microversion: 2.20 time: 0.102173 Aug 27 04:39:13.596089 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 429/859] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:39:13 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:13.607743 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-ef3883f0-c930-4a5b-af8b-5e53e316ef8e tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:13.608472 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-ef3883f0-c930-4a5b-af8b-5e53e316ef8e tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] [instance: cbccf205-2ebe-408e-8562-aad32ed0f52c] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:13.615181 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ef3883f0-c930-4a5b-af8b-5e53e316ef8e tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:13.616281 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ef3883f0-c930-4a5b-af8b-5e53e316ef8e tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:13.617042 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ef3883f0-c930-4a5b-af8b-5e53e316ef8e tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:13.617473 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ef3883f0-c930-4a5b-af8b-5e53e316ef8e tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:13.740632 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-ef3883f0-c930-4a5b-af8b-5e53e316ef8e tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175c169d2bfb4f0f89e2fdfe8485c999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbf39b95058423f95015e37925d1a8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:13.747830 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-ef3883f0-c930-4a5b-af8b-5e53e316ef8e tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] 10.222.0.53 "GET /compute/v2.1/servers/cbccf205-2ebe-408e-8562-aad32ed0f52c" status: 200 len: 1318 microversion: 2.1 time: 0.144351 Aug 27 04:39:13.748380 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 431/860] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:39:13 2021] GET /compute/v2.1/servers/cbccf205-2ebe-408e-8562-aad32ed0f52c => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:14.606915 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-7f53aaea-c01d-43c5-a418-c8782db4743b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:14.607909 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-7f53aaea-c01d-43c5-a418-c8782db4743b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:14.614698 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7f53aaea-c01d-43c5-a418-c8782db4743b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:14.615156 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7f53aaea-c01d-43c5-a418-c8782db4743b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:14.616592 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7f53aaea-c01d-43c5-a418-c8782db4743b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:14.616990 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7f53aaea-c01d-43c5-a418-c8782db4743b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:14.765210 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-93297369-be61-48d1-b81b-9cf39b57342c tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:14.765814 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-93297369-be61-48d1-b81b-9cf39b57342c tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] [instance: cbccf205-2ebe-408e-8562-aad32ed0f52c] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:14.772031 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-7f53aaea-c01d-43c5-a418-c8782db4743b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 14 microversion: 2.20 time: 0.168979 Aug 27 04:39:14.772501 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-93297369-be61-48d1-b81b-9cf39b57342c tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:14.772957 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 430/861] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:39:14 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 14 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:39:14.773078 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-93297369-be61-48d1-b81b-9cf39b57342c tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:14.773777 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-93297369-be61-48d1-b81b-9cf39b57342c tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:14.774216 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-93297369-be61-48d1-b81b-9cf39b57342c tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:14.897103 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-93297369-be61-48d1-b81b-9cf39b57342c tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175c169d2bfb4f0f89e2fdfe8485c999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbf39b95058423f95015e37925d1a8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:14.905372 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-93297369-be61-48d1-b81b-9cf39b57342c tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] 10.222.0.53 "GET /compute/v2.1/servers/cbccf205-2ebe-408e-8562-aad32ed0f52c" status: 200 len: 1318 microversion: 2.1 time: 0.143770 Aug 27 04:39:14.905932 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 432/862] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:39:14 2021] GET /compute/v2.1/servers/cbccf205-2ebe-408e-8562-aad32ed0f52c => generated 1318 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:39:15.783590 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-286ea9e4-42e9-4e02-bb74-03ac5fd0644d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:15.784612 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-286ea9e4-42e9-4e02-bb74-03ac5fd0644d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:15.791786 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-286ea9e4-42e9-4e02-bb74-03ac5fd0644d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:15.792273 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-286ea9e4-42e9-4e02-bb74-03ac5fd0644d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:15.793039 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-286ea9e4-42e9-4e02-bb74-03ac5fd0644d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:15.793476 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-286ea9e4-42e9-4e02-bb74-03ac5fd0644d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:15.887708 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-286ea9e4-42e9-4e02-bb74-03ac5fd0644d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 14 microversion: 2.20 time: 0.108148 Aug 27 04:39:15.888356 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 431/863] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:39:15 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:15.922047 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-0890a03d-8a3d-476a-be42-a8b5b88620d4 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:15.922653 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-0890a03d-8a3d-476a-be42-a8b5b88620d4 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] [instance: cbccf205-2ebe-408e-8562-aad32ed0f52c] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:15.928961 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0890a03d-8a3d-476a-be42-a8b5b88620d4 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:15.929402 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0890a03d-8a3d-476a-be42-a8b5b88620d4 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:15.930159 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0890a03d-8a3d-476a-be42-a8b5b88620d4 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:15.930583 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0890a03d-8a3d-476a-be42-a8b5b88620d4 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:16.048253 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-0890a03d-8a3d-476a-be42-a8b5b88620d4 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175c169d2bfb4f0f89e2fdfe8485c999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbf39b95058423f95015e37925d1a8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:16.055392 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-0890a03d-8a3d-476a-be42-a8b5b88620d4 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] 10.222.0.53 "GET /compute/v2.1/servers/cbccf205-2ebe-408e-8562-aad32ed0f52c" status: 200 len: 1507 microversion: 2.1 time: 0.136919 Aug 27 04:39:16.055944 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 433/864] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:39:15 2021] GET /compute/v2.1/servers/cbccf205-2ebe-408e-8562-aad32ed0f52c => generated 1507 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:16.072865 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-ab8d061f-ae28-4027-a07b-cde4a63a45a4 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "553d4b63-a3cf-448c-bb88-cf4ba92b9b10", "device": "/dev/sdb"}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:16.074037 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-ab8d061f-ae28-4027-a07b-cde4a63a45a4 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] [instance: cbccf205-2ebe-408e-8562-aad32ed0f52c] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:16.080471 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ab8d061f-ae28-4027-a07b-cde4a63a45a4 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:16.080923 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ab8d061f-ae28-4027-a07b-cde4a63a45a4 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:16.081694 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ab8d061f-ae28-4027-a07b-cde4a63a45a4 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:16.082134 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ab8d061f-ae28-4027-a07b-cde4a63a45a4 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:16.320665 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-ab8d061f-ae28-4027-a07b-cde4a63a45a4 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] 10.222.0.53 "POST /compute/v2.1/servers/cbccf205-2ebe-408e-8562-aad32ed0f52c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.251729 Aug 27 04:39:16.321250 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 432/865] 10.222.0.53 () {60 vars in 1323 bytes} [Fri Aug 27 04:39:16 2021] POST /compute/v2.1/servers/cbccf205-2ebe-408e-8562-aad32ed0f52c/os-volume_attachments => generated 194 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:39:16.898837 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-0fd06651-a981-44a2-95cc-b9fc98464e49 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:16.899674 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-0fd06651-a981-44a2-95cc-b9fc98464e49 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:16.905584 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0fd06651-a981-44a2-95cc-b9fc98464e49 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:16.906030 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0fd06651-a981-44a2-95cc-b9fc98464e49 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:16.906790 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0fd06651-a981-44a2-95cc-b9fc98464e49 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:16.907227 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0fd06651-a981-44a2-95cc-b9fc98464e49 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:16.993192 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-0fd06651-a981-44a2-95cc-b9fc98464e49 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 14 microversion: 2.20 time: 0.097974 Aug 27 04:39:16.993886 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 434/866] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:39:16 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:18.004999 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-ecc2b4d6-b82c-4a64-8fcd-f897e84b7f3b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:18.006726 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-ecc2b4d6-b82c-4a64-8fcd-f897e84b7f3b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:18.013681 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ecc2b4d6-b82c-4a64-8fcd-f897e84b7f3b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:18.014121 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ecc2b4d6-b82c-4a64-8fcd-f897e84b7f3b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:18.014874 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ecc2b4d6-b82c-4a64-8fcd-f897e84b7f3b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:18.015308 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ecc2b4d6-b82c-4a64-8fcd-f897e84b7f3b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:18.102994 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-ecc2b4d6-b82c-4a64-8fcd-f897e84b7f3b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 14 microversion: 2.20 time: 0.102403 Aug 27 04:39:18.103778 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 433/867] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:39:17 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:19.114183 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-26cf70fb-1abe-4d12-84f7-22b1899414b3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:19.115173 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-26cf70fb-1abe-4d12-84f7-22b1899414b3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:19.121636 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-26cf70fb-1abe-4d12-84f7-22b1899414b3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:19.122087 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-26cf70fb-1abe-4d12-84f7-22b1899414b3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:19.122849 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-26cf70fb-1abe-4d12-84f7-22b1899414b3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:19.123283 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-26cf70fb-1abe-4d12-84f7-22b1899414b3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:19.218636 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-26cf70fb-1abe-4d12-84f7-22b1899414b3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 14 microversion: 2.20 time: 0.108422 Aug 27 04:39:19.219464 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 435/868] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:39:19 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:20.230565 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-628eeaa0-7042-42b0-8e10-419b18bc0d58 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:20.231559 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-628eeaa0-7042-42b0-8e10-419b18bc0d58 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:20.238412 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-628eeaa0-7042-42b0-8e10-419b18bc0d58 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:20.238861 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-628eeaa0-7042-42b0-8e10-419b18bc0d58 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:20.239655 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-628eeaa0-7042-42b0-8e10-419b18bc0d58 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:20.240194 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-628eeaa0-7042-42b0-8e10-419b18bc0d58 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:20.336840 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-628eeaa0-7042-42b0-8e10-419b18bc0d58 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 14 microversion: 2.20 time: 0.110098 Aug 27 04:39:20.337485 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 434/869] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:39:20 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:21.348369 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-aaf72619-e99f-4e8c-842a-bb751b197910 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:21.349861 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-aaf72619-e99f-4e8c-842a-bb751b197910 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:21.356622 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-aaf72619-e99f-4e8c-842a-bb751b197910 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:21.357062 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-aaf72619-e99f-4e8c-842a-bb751b197910 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:21.357829 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-aaf72619-e99f-4e8c-842a-bb751b197910 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:21.358254 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-aaf72619-e99f-4e8c-842a-bb751b197910 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:21.469245 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-aaf72619-e99f-4e8c-842a-bb751b197910 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 7429 microversion: 2.20 time: 0.124856 Aug 27 04:39:21.469888 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 436/870] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:39:21 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 7429 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:39:22.481959 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-463faabd-28d9-4013-a6df-69e9eecb2100 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:22.482950 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-463faabd-28d9-4013-a6df-69e9eecb2100 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:22.489679 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-463faabd-28d9-4013-a6df-69e9eecb2100 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:22.490138 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-463faabd-28d9-4013-a6df-69e9eecb2100 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:22.490888 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-463faabd-28d9-4013-a6df-69e9eecb2100 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:22.491319 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-463faabd-28d9-4013-a6df-69e9eecb2100 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:22.586670 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-463faabd-28d9-4013-a6df-69e9eecb2100 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 15025 microversion: 2.20 time: 0.108690 Aug 27 04:39:22.587525 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 435/871] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:39:22 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 15025 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:39:23.599281 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-d9fe7557-594a-4804-bc6b-1bc279735d1a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:23.600287 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-d9fe7557-594a-4804-bc6b-1bc279735d1a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:23.606695 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d9fe7557-594a-4804-bc6b-1bc279735d1a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:23.607137 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d9fe7557-594a-4804-bc6b-1bc279735d1a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:23.607892 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d9fe7557-594a-4804-bc6b-1bc279735d1a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:23.608628 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d9fe7557-594a-4804-bc6b-1bc279735d1a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:23.716964 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-d9fe7557-594a-4804-bc6b-1bc279735d1a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 18356 microversion: 2.20 time: 0.122118 Aug 27 04:39:23.717613 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 437/872] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:39:23 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 18356 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:39:24.731198 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-09025099-e9bd-46d2-9382-6668fa00d9d5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:24.732139 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-09025099-e9bd-46d2-9382-6668fa00d9d5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:24.739088 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-09025099-e9bd-46d2-9382-6668fa00d9d5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:24.740059 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-09025099-e9bd-46d2-9382-6668fa00d9d5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:24.740833 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-09025099-e9bd-46d2-9382-6668fa00d9d5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:24.741271 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-09025099-e9bd-46d2-9382-6668fa00d9d5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:29.151682 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-09025099-e9bd-46d2-9382-6668fa00d9d5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 22666 microversion: 2.20 time: 4.425366 Aug 27 04:39:29.152378 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 436/873] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:39:24 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 22666 bytes in 4428 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:39:30.163645 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-3df2c9f1-214f-4e5d-8adf-bacd6785e3a5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:30.165186 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-3df2c9f1-214f-4e5d-8adf-bacd6785e3a5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:30.171558 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3df2c9f1-214f-4e5d-8adf-bacd6785e3a5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:30.172029 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3df2c9f1-214f-4e5d-8adf-bacd6785e3a5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:30.172796 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3df2c9f1-214f-4e5d-8adf-bacd6785e3a5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:30.173258 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3df2c9f1-214f-4e5d-8adf-bacd6785e3a5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:30.277559 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-3df2c9f1-214f-4e5d-8adf-bacd6785e3a5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 25801 microversion: 2.20 time: 0.117874 Aug 27 04:39:30.278213 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 438/874] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:39:30 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 25801 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:39:31.290307 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-868b45df-a105-4a7e-a2b2-bcdc68d8bf04 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:31.291295 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-868b45df-a105-4a7e-a2b2-bcdc68d8bf04 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:31.297666 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-868b45df-a105-4a7e-a2b2-bcdc68d8bf04 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:31.298116 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-868b45df-a105-4a7e-a2b2-bcdc68d8bf04 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:31.298876 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-868b45df-a105-4a7e-a2b2-bcdc68d8bf04 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:31.299314 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-868b45df-a105-4a7e-a2b2-bcdc68d8bf04 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:31.428221 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-868b45df-a105-4a7e-a2b2-bcdc68d8bf04 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 26934 microversion: 2.20 time: 0.142255 Aug 27 04:39:31.432025 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 437/875] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:39:31 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 26934 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:39:32.440531 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-f2cf07aa-3a87-4715-8841-36d2aa00e3ab tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:32.441545 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-f2cf07aa-3a87-4715-8841-36d2aa00e3ab tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:32.448527 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f2cf07aa-3a87-4715-8841-36d2aa00e3ab tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:32.448973 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f2cf07aa-3a87-4715-8841-36d2aa00e3ab tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:32.449734 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f2cf07aa-3a87-4715-8841-36d2aa00e3ab tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:32.450168 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f2cf07aa-3a87-4715-8841-36d2aa00e3ab tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:35.655697 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-b666221d-917b-42cd-be79-312f75d03543 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:35.656280 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-b666221d-917b-42cd-be79-312f75d03543 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:35.662988 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b666221d-917b-42cd-be79-312f75d03543 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:35.663438 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b666221d-917b-42cd-be79-312f75d03543 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:35.664340 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b666221d-917b-42cd-be79-312f75d03543 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:35.664685 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b666221d-917b-42cd-be79-312f75d03543 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:35.686460 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.objects.instance [None req-b666221d-917b-42cd-be79-312f75d03543 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lazy-loading 'flavor' on Instance uuid e2051c4e-353b-4875-8217-513125bcaf66 {{(pid=108970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:39:35.753442 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-b666221d-917b-42cd-be79-312f75d03543 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "POST /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66/action" status: 202 len: 0 microversion: 2.1 time: 0.101756 Aug 27 04:39:35.754013 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 438/876] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:39:35 2021] POST /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:39:35.762512 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-3cf84fda-7054-4156-ba43-eebfa1cda547 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:35.763195 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-3cf84fda-7054-4156-ba43-eebfa1cda547 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:35.769102 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3cf84fda-7054-4156-ba43-eebfa1cda547 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:35.769546 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3cf84fda-7054-4156-ba43-eebfa1cda547 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:35.770297 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3cf84fda-7054-4156-ba43-eebfa1cda547 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:35.770729 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3cf84fda-7054-4156-ba43-eebfa1cda547 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:36.005763 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-f2cf07aa-3a87-4715-8841-36d2aa00e3ab tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 27770 microversion: 2.20 time: 3.569196 Aug 27 04:39:36.006790 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 439/877] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:39:32 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 27770 bytes in 3571 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:39:36.130090 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-3cf84fda-7054-4156-ba43-eebfa1cda547 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:36.138601 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-3cf84fda-7054-4156-ba43-eebfa1cda547 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1567 microversion: 2.1 time: 0.379687 Aug 27 04:39:36.139161 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 439/878] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:39:35 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1567 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:39:37.017775 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-5317994e-6d66-46dd-a5f0-0c1e48dae6ad tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:37.018956 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-5317994e-6d66-46dd-a5f0-0c1e48dae6ad tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:37.026358 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5317994e-6d66-46dd-a5f0-0c1e48dae6ad tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:37.026811 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5317994e-6d66-46dd-a5f0-0c1e48dae6ad tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:37.027580 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5317994e-6d66-46dd-a5f0-0c1e48dae6ad tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:37.028041 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5317994e-6d66-46dd-a5f0-0c1e48dae6ad tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:37.153575 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-5317994e-6d66-46dd-a5f0-0c1e48dae6ad tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 27835 microversion: 2.20 time: 0.139968 Aug 27 04:39:37.157364 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 440/879] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:39:37 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 27835 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:39:37.157509 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-bfc9f99e-4db3-4171-89e9-6240a6b2e13e tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:37.157509 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-bfc9f99e-4db3-4171-89e9-6240a6b2e13e tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:37.162643 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-bfc9f99e-4db3-4171-89e9-6240a6b2e13e tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:37.163266 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-bfc9f99e-4db3-4171-89e9-6240a6b2e13e tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:37.164065 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-bfc9f99e-4db3-4171-89e9-6240a6b2e13e tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:37.164496 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-bfc9f99e-4db3-4171-89e9-6240a6b2e13e tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:37.280334 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-bfc9f99e-4db3-4171-89e9-6240a6b2e13e tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:37.287561 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-bfc9f99e-4db3-4171-89e9-6240a6b2e13e tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1567 microversion: 2.1 time: 0.135433 Aug 27 04:39:37.288121 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 440/880] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:39:37 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1567 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:39:38.166224 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-7ce1560f-dcfc-4dfb-b395-faafe1ef4030 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:38.167126 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-7ce1560f-dcfc-4dfb-b395-faafe1ef4030 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:38.173577 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7ce1560f-dcfc-4dfb-b395-faafe1ef4030 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:38.174022 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7ce1560f-dcfc-4dfb-b395-faafe1ef4030 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:38.174772 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7ce1560f-dcfc-4dfb-b395-faafe1ef4030 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:38.175197 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7ce1560f-dcfc-4dfb-b395-faafe1ef4030 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:38.285714 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-7ce1560f-dcfc-4dfb-b395-faafe1ef4030 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 27836 microversion: 2.20 time: 0.124024 Aug 27 04:39:38.286601 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 441/881] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:39:38 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 27836 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:39:38.304306 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-c45c5ace-fb56-4ffa-ac66-3a38766a980c tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:38.305187 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-c45c5ace-fb56-4ffa-ac66-3a38766a980c tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:38.311623 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-c45c5ace-fb56-4ffa-ac66-3a38766a980c tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:38.312148 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-c45c5ace-fb56-4ffa-ac66-3a38766a980c tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:38.312928 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-c45c5ace-fb56-4ffa-ac66-3a38766a980c tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:38.313365 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-c45c5ace-fb56-4ffa-ac66-3a38766a980c tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:38.430772 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-c45c5ace-fb56-4ffa-ac66-3a38766a980c tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:38.438154 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-c45c5ace-fb56-4ffa-ac66-3a38766a980c tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1567 microversion: 2.1 time: 0.137517 Aug 27 04:39:38.438723 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 441/882] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:39:38 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1567 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:39.297725 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-2b2f6e09-f84d-4d94-8ef2-97bc4a4ed79f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:39.298698 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-2b2f6e09-f84d-4d94-8ef2-97bc4a4ed79f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:39.305713 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-2b2f6e09-f84d-4d94-8ef2-97bc4a4ed79f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:39.306180 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-2b2f6e09-f84d-4d94-8ef2-97bc4a4ed79f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:39.306953 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-2b2f6e09-f84d-4d94-8ef2-97bc4a4ed79f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:39.307378 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-2b2f6e09-f84d-4d94-8ef2-97bc4a4ed79f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:39.430977 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-2b2f6e09-f84d-4d94-8ef2-97bc4a4ed79f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 27962 microversion: 2.20 time: 0.137057 Aug 27 04:39:39.431612 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 442/883] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:39:39 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 27962 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:39:39.454730 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-255e94d2-d721-4a70-b445-de285af5715d tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:39.455335 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-255e94d2-d721-4a70-b445-de285af5715d tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:39.461519 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-255e94d2-d721-4a70-b445-de285af5715d tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:39.461962 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-255e94d2-d721-4a70-b445-de285af5715d tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:39.462725 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-255e94d2-d721-4a70-b445-de285af5715d tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:39.463156 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-255e94d2-d721-4a70-b445-de285af5715d tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:39.593267 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-255e94d2-d721-4a70-b445-de285af5715d tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:39.600668 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-255e94d2-d721-4a70-b445-de285af5715d tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1567 microversion: 2.1 time: 0.149487 Aug 27 04:39:39.601237 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 442/884] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:39:39 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:39:40.442799 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-e6ee3634-08ad-4d06-8799-419c02b8cb79 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:40.443798 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-e6ee3634-08ad-4d06-8799-419c02b8cb79 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:40.450906 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e6ee3634-08ad-4d06-8799-419c02b8cb79 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:40.451460 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e6ee3634-08ad-4d06-8799-419c02b8cb79 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:40.452253 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e6ee3634-08ad-4d06-8799-419c02b8cb79 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:40.452691 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e6ee3634-08ad-4d06-8799-419c02b8cb79 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:40.558783 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-e6ee3634-08ad-4d06-8799-419c02b8cb79 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28080 microversion: 2.20 time: 0.119893 Aug 27 04:39:40.559403 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 443/885] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:39:40 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28080 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:39:40.618703 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-ba5fb030-ddaf-4854-bf99-960d6c80f4da tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:40.619247 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-ba5fb030-ddaf-4854-bf99-960d6c80f4da tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:40.625153 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ba5fb030-ddaf-4854-bf99-960d6c80f4da tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:40.625604 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ba5fb030-ddaf-4854-bf99-960d6c80f4da tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:40.626403 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ba5fb030-ddaf-4854-bf99-960d6c80f4da tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:40.626843 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ba5fb030-ddaf-4854-bf99-960d6c80f4da tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:40.676203 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-bd838fee-80c9-424d-bc06-1b8293dcf12f tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:40.676774 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-bd838fee-80c9-424d-bc06-1b8293dcf12f tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] [instance: cbccf205-2ebe-408e-8562-aad32ed0f52c] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:40.683811 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-bd838fee-80c9-424d-bc06-1b8293dcf12f tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:40.684268 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-bd838fee-80c9-424d-bc06-1b8293dcf12f tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:40.685034 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-bd838fee-80c9-424d-bc06-1b8293dcf12f tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:40.685465 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-bd838fee-80c9-424d-bc06-1b8293dcf12f tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:40.745714 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-ba5fb030-ddaf-4854-bf99-960d6c80f4da tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:40.752998 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-ba5fb030-ddaf-4854-bf99-960d6c80f4da tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1567 microversion: 2.1 time: 0.138510 Aug 27 04:39:40.753572 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 443/886] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:39:40 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1567 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:40.767460 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.objects.instance [None req-bd838fee-80c9-424d-bc06-1b8293dcf12f tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lazy-loading 'services' on Instance uuid cbccf205-2ebe-408e-8562-aad32ed0f52c {{(pid=108971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:39:40.830228 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-bd838fee-80c9-424d-bc06-1b8293dcf12f tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] 10.222.0.53 "DELETE /compute/v2.1/servers/cbccf205-2ebe-408e-8562-aad32ed0f52c/os-volume_attachments/553d4b63-a3cf-448c-bb88-cf4ba92b9b10" status: 202 len: 0 microversion: 2.1 time: 0.157919 Aug 27 04:39:40.830830 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 444/887] 10.222.0.53 () {58 vars in 1416 bytes} [Fri Aug 27 04:39:40 2021] DELETE /compute/v2.1/servers/cbccf205-2ebe-408e-8562-aad32ed0f52c/os-volume_attachments/553d4b63-a3cf-448c-bb88-cf4ba92b9b10 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:39:41.570334 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-ae36e984-e77c-41df-9a6b-d33d9b915196 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:41.571238 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-ae36e984-e77c-41df-9a6b-d33d9b915196 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:41.576959 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ae36e984-e77c-41df-9a6b-d33d9b915196 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:41.577401 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ae36e984-e77c-41df-9a6b-d33d9b915196 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:41.578185 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ae36e984-e77c-41df-9a6b-d33d9b915196 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:41.578611 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ae36e984-e77c-41df-9a6b-d33d9b915196 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:41.718930 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-ae36e984-e77c-41df-9a6b-d33d9b915196 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28195 microversion: 2.20 time: 0.152012 Aug 27 04:39:41.719547 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 444/888] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:39:41 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28195 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:39:41.770958 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-64272511-d5db-4b9d-ae4d-284943a0627a tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:41.771659 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-64272511-d5db-4b9d-ae4d-284943a0627a tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:41.778418 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-64272511-d5db-4b9d-ae4d-284943a0627a tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:41.778855 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-64272511-d5db-4b9d-ae4d-284943a0627a tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:41.779607 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-64272511-d5db-4b9d-ae4d-284943a0627a tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:41.780063 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-64272511-d5db-4b9d-ae4d-284943a0627a tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:41.902636 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-64272511-d5db-4b9d-ae4d-284943a0627a tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:41.909934 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-64272511-d5db-4b9d-ae4d-284943a0627a tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1567 microversion: 2.1 time: 0.143480 Aug 27 04:39:41.910494 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 445/889] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:39:41 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1567 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:42.730873 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-4cc98111-f090-415e-a376-5b350bba1b8f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:42.731796 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-4cc98111-f090-415e-a376-5b350bba1b8f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:42.738577 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4cc98111-f090-415e-a376-5b350bba1b8f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:42.739158 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4cc98111-f090-415e-a376-5b350bba1b8f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:42.739946 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4cc98111-f090-415e-a376-5b350bba1b8f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:42.740410 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4cc98111-f090-415e-a376-5b350bba1b8f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:42.865735 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-4cc98111-f090-415e-a376-5b350bba1b8f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28197 microversion: 2.20 time: 0.138821 Aug 27 04:39:42.866361 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 445/890] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:39:42 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:39:42.926213 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-09a74129-70a0-4e62-9b53-89e6781c3cac tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:42.926860 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-09a74129-70a0-4e62-9b53-89e6781c3cac tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:42.933378 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-09a74129-70a0-4e62-9b53-89e6781c3cac tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:42.933824 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-09a74129-70a0-4e62-9b53-89e6781c3cac tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:42.934585 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-09a74129-70a0-4e62-9b53-89e6781c3cac tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:42.935018 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-09a74129-70a0-4e62-9b53-89e6781c3cac tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:43.000299 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-7fcca5c4-cf49-4ce4-8264-8d3887a78703 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:43.000886 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-7fcca5c4-cf49-4ce4-8264-8d3887a78703 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] [instance: cbccf205-2ebe-408e-8562-aad32ed0f52c] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:43.007101 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7fcca5c4-cf49-4ce4-8264-8d3887a78703 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:43.007552 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7fcca5c4-cf49-4ce4-8264-8d3887a78703 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:43.008355 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7fcca5c4-cf49-4ce4-8264-8d3887a78703 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:43.008796 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7fcca5c4-cf49-4ce4-8264-8d3887a78703 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:43.033943 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-7fcca5c4-cf49-4ce4-8264-8d3887a78703 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] [instance: cbccf205-2ebe-408e-8562-aad32ed0f52c] Going to try to terminate instance {{(pid=108970) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 04:39:43.053116 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-09a74129-70a0-4e62-9b53-89e6781c3cac tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:43.061014 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-09a74129-70a0-4e62-9b53-89e6781c3cac tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1567 microversion: 2.1 time: 0.138401 Aug 27 04:39:43.061584 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 446/891] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:39:42 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1567 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:43.106895 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-7fcca5c4-cf49-4ce4-8264-8d3887a78703 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] 10.222.0.53 "DELETE /compute/v2.1/servers/cbccf205-2ebe-408e-8562-aad32ed0f52c" status: 204 len: 0 microversion: 2.1 time: 0.110304 Aug 27 04:39:43.107482 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 446/892] 10.222.0.53 () {58 vars in 1239 bytes} [Fri Aug 27 04:39:42 2021] DELETE /compute/v2.1/servers/cbccf205-2ebe-408e-8562-aad32ed0f52c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 04:39:43.116111 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-5e407a9f-d7f3-409d-adf1-52f1207f4a23 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:43.116722 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-5e407a9f-d7f3-409d-adf1-52f1207f4a23 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] [instance: cbccf205-2ebe-408e-8562-aad32ed0f52c] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:43.123104 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5e407a9f-d7f3-409d-adf1-52f1207f4a23 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:43.123555 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5e407a9f-d7f3-409d-adf1-52f1207f4a23 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:43.124351 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5e407a9f-d7f3-409d-adf1-52f1207f4a23 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:43.124817 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5e407a9f-d7f3-409d-adf1-52f1207f4a23 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:43.245007 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-5e407a9f-d7f3-409d-adf1-52f1207f4a23 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175c169d2bfb4f0f89e2fdfe8485c999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbf39b95058423f95015e37925d1a8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:43.252146 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-5e407a9f-d7f3-409d-adf1-52f1207f4a23 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] 10.222.0.53 "GET /compute/v2.1/servers/cbccf205-2ebe-408e-8562-aad32ed0f52c" status: 200 len: 1513 microversion: 2.1 time: 0.140058 Aug 27 04:39:43.252707 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 447/893] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:39:43 2021] GET /compute/v2.1/servers/cbccf205-2ebe-408e-8562-aad32ed0f52c => generated 1513 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:43.878568 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-6faafdee-bc60-492c-bef2-07ff87c01c02 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:43.879559 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-6faafdee-bc60-492c-bef2-07ff87c01c02 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:43.886015 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6faafdee-bc60-492c-bef2-07ff87c01c02 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:43.886455 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6faafdee-bc60-492c-bef2-07ff87c01c02 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:43.887209 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6faafdee-bc60-492c-bef2-07ff87c01c02 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:43.887641 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6faafdee-bc60-492c-bef2-07ff87c01c02 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:44.005223 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-6faafdee-bc60-492c-bef2-07ff87c01c02 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28197 microversion: 2.20 time: 0.130618 Aug 27 04:39:44.005840 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 447/894] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:39:43 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:39:44.077664 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-7302f0be-d6a9-4117-8d1d-f8cb07fe5fe3 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:44.078273 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-7302f0be-d6a9-4117-8d1d-f8cb07fe5fe3 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:44.084596 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7302f0be-d6a9-4117-8d1d-f8cb07fe5fe3 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:44.085038 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7302f0be-d6a9-4117-8d1d-f8cb07fe5fe3 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:44.085799 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7302f0be-d6a9-4117-8d1d-f8cb07fe5fe3 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:44.086231 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7302f0be-d6a9-4117-8d1d-f8cb07fe5fe3 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:44.210658 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-7302f0be-d6a9-4117-8d1d-f8cb07fe5fe3 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:44.218192 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-7302f0be-d6a9-4117-8d1d-f8cb07fe5fe3 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1567 microversion: 2.1 time: 0.144129 Aug 27 04:39:44.218765 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 448/895] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:39:44 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1567 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:44.269692 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-86e25591-3e47-4597-920a-d3f8bea995d5 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:44.270396 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-86e25591-3e47-4597-920a-d3f8bea995d5 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] [instance: cbccf205-2ebe-408e-8562-aad32ed0f52c] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:44.276900 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-86e25591-3e47-4597-920a-d3f8bea995d5 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:44.277354 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-86e25591-3e47-4597-920a-d3f8bea995d5 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:44.278127 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-86e25591-3e47-4597-920a-d3f8bea995d5 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:44.278571 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-86e25591-3e47-4597-920a-d3f8bea995d5 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:44.396011 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-86e25591-3e47-4597-920a-d3f8bea995d5 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175c169d2bfb4f0f89e2fdfe8485c999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbf39b95058423f95015e37925d1a8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:44.403305 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-86e25591-3e47-4597-920a-d3f8bea995d5 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] 10.222.0.53 "GET /compute/v2.1/servers/cbccf205-2ebe-408e-8562-aad32ed0f52c" status: 200 len: 1513 microversion: 2.1 time: 0.137625 Aug 27 04:39:44.403864 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 448/896] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:39:44 2021] GET /compute/v2.1/servers/cbccf205-2ebe-408e-8562-aad32ed0f52c => generated 1513 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:45.017200 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-5c261605-a027-4fc1-8413-6fe2c0465f5b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:45.018173 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-5c261605-a027-4fc1-8413-6fe2c0465f5b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:45.024498 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5c261605-a027-4fc1-8413-6fe2c0465f5b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:45.024938 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5c261605-a027-4fc1-8413-6fe2c0465f5b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:45.025686 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5c261605-a027-4fc1-8413-6fe2c0465f5b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:45.026112 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5c261605-a027-4fc1-8413-6fe2c0465f5b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:45.161165 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-5c261605-a027-4fc1-8413-6fe2c0465f5b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28197 microversion: 2.20 time: 0.147494 Aug 27 04:39:45.161814 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 449/897] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:39:45 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:39:45.234538 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-694728c5-c89f-481b-ad37-1bd9c6240eed tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:45.235159 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-694728c5-c89f-481b-ad37-1bd9c6240eed tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:45.241074 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-694728c5-c89f-481b-ad37-1bd9c6240eed tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:45.241513 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-694728c5-c89f-481b-ad37-1bd9c6240eed tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:45.242265 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-694728c5-c89f-481b-ad37-1bd9c6240eed tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:45.242700 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-694728c5-c89f-481b-ad37-1bd9c6240eed tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:45.362135 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-694728c5-c89f-481b-ad37-1bd9c6240eed tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:45.369572 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-694728c5-c89f-481b-ad37-1bd9c6240eed tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1567 microversion: 2.1 time: 0.138905 Aug 27 04:39:45.370138 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 449/898] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:39:45 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1567 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:45.420616 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-007650e0-ad2d-4a95-a560-ffb0973a0d26 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:45.421305 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-007650e0-ad2d-4a95-a560-ffb0973a0d26 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] [instance: cbccf205-2ebe-408e-8562-aad32ed0f52c] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:45.427822 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-007650e0-ad2d-4a95-a560-ffb0973a0d26 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:45.428294 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-007650e0-ad2d-4a95-a560-ffb0973a0d26 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:45.429060 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-007650e0-ad2d-4a95-a560-ffb0973a0d26 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:45.429522 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-007650e0-ad2d-4a95-a560-ffb0973a0d26 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:45.547973 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-007650e0-ad2d-4a95-a560-ffb0973a0d26 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175c169d2bfb4f0f89e2fdfe8485c999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbf39b95058423f95015e37925d1a8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:45.555794 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-007650e0-ad2d-4a95-a560-ffb0973a0d26 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] 10.222.0.53 "GET /compute/v2.1/servers/cbccf205-2ebe-408e-8562-aad32ed0f52c" status: 200 len: 1513 microversion: 2.1 time: 0.139173 Aug 27 04:39:45.556376 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 450/899] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:39:45 2021] GET /compute/v2.1/servers/cbccf205-2ebe-408e-8562-aad32ed0f52c => generated 1513 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:46.172848 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-fe19457a-0ade-4cee-8e55-ac4f1850d2aa tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:46.173737 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-fe19457a-0ade-4cee-8e55-ac4f1850d2aa tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:46.180319 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fe19457a-0ade-4cee-8e55-ac4f1850d2aa tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:46.180771 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fe19457a-0ade-4cee-8e55-ac4f1850d2aa tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:46.181532 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fe19457a-0ade-4cee-8e55-ac4f1850d2aa tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:46.181970 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fe19457a-0ade-4cee-8e55-ac4f1850d2aa tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:46.386206 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-4bcdcfc9-cbab-4458-9fb6-520bf7b52a05 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:46.386814 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-4bcdcfc9-cbab-4458-9fb6-520bf7b52a05 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:46.392723 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-4bcdcfc9-cbab-4458-9fb6-520bf7b52a05 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:46.393178 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-4bcdcfc9-cbab-4458-9fb6-520bf7b52a05 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:46.394589 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-4bcdcfc9-cbab-4458-9fb6-520bf7b52a05 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:46.395213 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-4bcdcfc9-cbab-4458-9fb6-520bf7b52a05 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:46.397629 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-fe19457a-0ade-4cee-8e55-ac4f1850d2aa tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28197 microversion: 2.20 time: 0.228338 Aug 27 04:39:46.402118 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 450/900] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:39:46 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28197 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:39:46.511981 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-4bcdcfc9-cbab-4458-9fb6-520bf7b52a05 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:46.519201 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-4bcdcfc9-cbab-4458-9fb6-520bf7b52a05 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1567 microversion: 2.1 time: 0.136575 Aug 27 04:39:46.519761 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 451/901] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:39:46 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1567 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:39:46.573081 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-5090991f-7d6d-423b-b572-eb593d70ea9c tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:46.573766 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-5090991f-7d6d-423b-b572-eb593d70ea9c tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] [instance: cbccf205-2ebe-408e-8562-aad32ed0f52c] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:46.580153 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5090991f-7d6d-423b-b572-eb593d70ea9c tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:46.580596 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5090991f-7d6d-423b-b572-eb593d70ea9c tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:46.581379 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5090991f-7d6d-423b-b572-eb593d70ea9c tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:46.581905 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5090991f-7d6d-423b-b572-eb593d70ea9c tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:46.702389 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-5090991f-7d6d-423b-b572-eb593d70ea9c tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175c169d2bfb4f0f89e2fdfe8485c999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbf39b95058423f95015e37925d1a8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:46.709693 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-5090991f-7d6d-423b-b572-eb593d70ea9c tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] 10.222.0.53 "GET /compute/v2.1/servers/cbccf205-2ebe-408e-8562-aad32ed0f52c" status: 200 len: 1513 microversion: 2.1 time: 0.140562 Aug 27 04:39:46.710457 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 451/902] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:39:46 2021] GET /compute/v2.1/servers/cbccf205-2ebe-408e-8562-aad32ed0f52c => generated 1513 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:47.043810 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [req-fc1575d2-40fb-4d64-b2cb-311e99055a21 req-b179cebf-d441-4f00-8c43-5191b087861c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbccf205-2ebe-408e-8562-aad32ed0f52c", "name": "network-vif-deleted", "tag": "2059b96a-970e-44aa-95b2-28f50884a53e"}]} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:47.045661 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:39:47.045661 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: warnings.warn(msg) Aug 27 04:39:47.052784 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-fc1575d2-40fb-4d64-b2cb-311e99055a21 req-b179cebf-d441-4f00-8c43-5191b087861c service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:47.053216 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-fc1575d2-40fb-4d64-b2cb-311e99055a21 req-b179cebf-d441-4f00-8c43-5191b087861c service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:47.064152 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.compute.server_external_events [req-fc1575d2-40fb-4d64-b2cb-311e99055a21 req-b179cebf-d441-4f00-8c43-5191b087861c service nova] Creating event network-vif-deleted:2059b96a-970e-44aa-95b2-28f50884a53e for instance cbccf205-2ebe-408e-8562-aad32ed0f52c on hv-cinder-80403 Aug 27 04:39:47.068927 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [req-fc1575d2-40fb-4d64-b2cb-311e99055a21 req-b179cebf-d441-4f00-8c43-5191b087861c service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028791 Aug 27 04:39:47.069577 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 452/903] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:39:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:39:47.409660 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-c8c601ad-e12b-4fb9-a6e2-4cd25dbbfbb0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:47.410569 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-c8c601ad-e12b-4fb9-a6e2-4cd25dbbfbb0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:47.416817 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-c8c601ad-e12b-4fb9-a6e2-4cd25dbbfbb0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:47.417267 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-c8c601ad-e12b-4fb9-a6e2-4cd25dbbfbb0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:47.418028 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-c8c601ad-e12b-4fb9-a6e2-4cd25dbbfbb0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:47.418469 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-c8c601ad-e12b-4fb9-a6e2-4cd25dbbfbb0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:47.536645 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-4095db06-79b0-49eb-ab33-7993e174fb4a tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:47.537279 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-4095db06-79b0-49eb-ab33-7993e174fb4a tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:47.543895 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-4095db06-79b0-49eb-ab33-7993e174fb4a tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:47.544372 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-4095db06-79b0-49eb-ab33-7993e174fb4a tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:47.545128 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-4095db06-79b0-49eb-ab33-7993e174fb4a tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:47.545559 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-4095db06-79b0-49eb-ab33-7993e174fb4a tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:47.560039 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-c8c601ad-e12b-4fb9-a6e2-4cd25dbbfbb0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28197 microversion: 2.20 time: 0.153882 Aug 27 04:39:47.560686 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 452/904] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:39:47 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28197 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:39:47.666626 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-4095db06-79b0-49eb-ab33-7993e174fb4a tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:47.673813 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-4095db06-79b0-49eb-ab33-7993e174fb4a tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1567 microversion: 2.1 time: 0.141242 Aug 27 04:39:47.674372 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 453/905] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:39:47 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1567 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:39:47.728065 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-4b53c8dc-854f-48b0-b3e5-d2df75de014f tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:47.728762 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-4b53c8dc-854f-48b0-b3e5-d2df75de014f tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] [instance: cbccf205-2ebe-408e-8562-aad32ed0f52c] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:47.735173 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4b53c8dc-854f-48b0-b3e5-d2df75de014f tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:47.735620 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4b53c8dc-854f-48b0-b3e5-d2df75de014f tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:47.736428 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4b53c8dc-854f-48b0-b3e5-d2df75de014f tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:47.736865 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4b53c8dc-854f-48b0-b3e5-d2df75de014f tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:47.766384 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4b53c8dc-854f-48b0-b3e5-d2df75de014f tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:47.766829 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4b53c8dc-854f-48b0-b3e5-d2df75de014f tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:47.767271 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.objects.instance [None req-4b53c8dc-854f-48b0-b3e5-d2df75de014f tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lazy-loading 'fault' on Instance uuid cbccf205-2ebe-408e-8562-aad32ed0f52c {{(pid=108970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:39:47.806683 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-4b53c8dc-854f-48b0-b3e5-d2df75de014f tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175c169d2bfb4f0f89e2fdfe8485c999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbf39b95058423f95015e37925d1a8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:47.813809 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-4b53c8dc-854f-48b0-b3e5-d2df75de014f tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] 10.222.0.53 "GET /compute/v2.1/servers/cbccf205-2ebe-408e-8562-aad32ed0f52c" status: 200 len: 1308 microversion: 2.1 time: 0.090038 Aug 27 04:39:47.814370 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 453/906] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:39:47 2021] GET /compute/v2.1/servers/cbccf205-2ebe-408e-8562-aad32ed0f52c => generated 1308 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:48.571448 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-882da5c4-f90b-45f5-bf9d-3aca444111ab tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:48.572376 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-882da5c4-f90b-45f5-bf9d-3aca444111ab tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:48.578621 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-882da5c4-f90b-45f5-bf9d-3aca444111ab tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:48.579068 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-882da5c4-f90b-45f5-bf9d-3aca444111ab tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:48.579822 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-882da5c4-f90b-45f5-bf9d-3aca444111ab tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:48.580286 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-882da5c4-f90b-45f5-bf9d-3aca444111ab tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:48.656323 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-d287489f-82f2-46e1-977b-0158fd30feba tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:48.657228 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-d287489f-82f2-46e1-977b-0158fd30feba tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:48.662905 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d287489f-82f2-46e1-977b-0158fd30feba tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:48.663350 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d287489f-82f2-46e1-977b-0158fd30feba tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:48.664784 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d287489f-82f2-46e1-977b-0158fd30feba tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:48.665218 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d287489f-82f2-46e1-977b-0158fd30feba tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:48.687264 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-882da5c4-f90b-45f5-bf9d-3aca444111ab tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28197 microversion: 2.20 time: 0.119357 Aug 27 04:39:48.691172 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 454/907] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:39:48 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:39:48.692570 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-d287489f-82f2-46e1-977b-0158fd30feba tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.039994 Aug 27 04:39:48.692865 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-c65487cf-9681-43c3-977d-c07c72c32e49 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:48.693130 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 454/908] 10.222.0.53 () {58 vars in 1302 bytes} [Fri Aug 27 04:39:48 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b/os-volume_attachments => generated 25 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 04:39:48.693582 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-c65487cf-9681-43c3-977d-c07c72c32e49 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:48.700103 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c65487cf-9681-43c3-977d-c07c72c32e49 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:48.700560 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c65487cf-9681-43c3-977d-c07c72c32e49 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:48.701337 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c65487cf-9681-43c3-977d-c07c72c32e49 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:48.702072 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c65487cf-9681-43c3-977d-c07c72c32e49 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:48.754852 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-6f49052f-5177-4f00-96e2-3de96b3efbcb tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:48.755348 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-6f49052f-5177-4f00-96e2-3de96b3efbcb tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:48.761633 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6f49052f-5177-4f00-96e2-3de96b3efbcb tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:48.762086 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6f49052f-5177-4f00-96e2-3de96b3efbcb tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:48.762857 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6f49052f-5177-4f00-96e2-3de96b3efbcb tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:48.763296 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6f49052f-5177-4f00-96e2-3de96b3efbcb tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:48.787865 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-6f49052f-5177-4f00-96e2-3de96b3efbcb tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Going to try to terminate instance {{(pid=108970) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 04:39:48.827100 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-c65487cf-9681-43c3-977d-c07c72c32e49 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:48.834692 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-c65487cf-9681-43c3-977d-c07c72c32e49 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1567 microversion: 2.1 time: 0.145462 Aug 27 04:39:48.835267 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 455/909] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:39:48 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1567 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:48.840264 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-2992894b-29bf-4395-b57f-30cdce88eff0 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:48.840870 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-2992894b-29bf-4395-b57f-30cdce88eff0 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] [instance: cbccf205-2ebe-408e-8562-aad32ed0f52c] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:48.848695 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-2992894b-29bf-4395-b57f-30cdce88eff0 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:48.849131 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-2992894b-29bf-4395-b57f-30cdce88eff0 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:48.849900 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-2992894b-29bf-4395-b57f-30cdce88eff0 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:48.850573 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-2992894b-29bf-4395-b57f-30cdce88eff0 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:48.867129 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.wsgi [None req-2992894b-29bf-4395-b57f-30cdce88eff0 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] HTTP exception thrown: Instance cbccf205-2ebe-408e-8562-aad32ed0f52c could not be found. Aug 27 04:39:48.867991 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-6f49052f-5177-4f00-96e2-3de96b3efbcb tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "DELETE /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 204 len: 0 microversion: 2.1 time: 0.116501 Aug 27 04:39:48.868443 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-2992894b-29bf-4395-b57f-30cdce88eff0 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] Returning 404 to user: Instance cbccf205-2ebe-408e-8562-aad32ed0f52c could not be found. {{(pid=108971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:39:48.868900 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 455/910] 10.222.0.53 () {58 vars in 1239 bytes} [Fri Aug 27 04:39:48 2021] DELETE /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 04:39:48.869738 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-2992894b-29bf-4395-b57f-30cdce88eff0 tempest-VolumesSnapshotTestJSON-778627873 tempest-VolumesSnapshotTestJSON-778627873-project] 10.222.0.53 "GET /compute/v2.1/servers/cbccf205-2ebe-408e-8562-aad32ed0f52c" status: 404 len: 111 microversion: 2.1 time: 0.032678 Aug 27 04:39:48.870456 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 456/911] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:39:48 2021] GET /compute/v2.1/servers/cbccf205-2ebe-408e-8562-aad32ed0f52c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:39:48.878512 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-48e53064-5f2a-4958-92ee-05e258825346 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:48.879613 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-48e53064-5f2a-4958-92ee-05e258825346 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:48.887266 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-48e53064-5f2a-4958-92ee-05e258825346 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:48.887844 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-48e53064-5f2a-4958-92ee-05e258825346 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:48.888586 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-48e53064-5f2a-4958-92ee-05e258825346 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:48.889007 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-48e53064-5f2a-4958-92ee-05e258825346 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:49.015474 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-48e53064-5f2a-4958-92ee-05e258825346 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:49.022707 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-48e53064-5f2a-4958-92ee-05e258825346 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1674 microversion: 2.1 time: 0.148170 Aug 27 04:39:49.023905 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 456/912] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:39:48 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1674 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:49.698777 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-49784593-9688-4159-aeed-6b72bc6cb18f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:49.699672 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-49784593-9688-4159-aeed-6b72bc6cb18f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:49.705816 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-49784593-9688-4159-aeed-6b72bc6cb18f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:49.706254 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-49784593-9688-4159-aeed-6b72bc6cb18f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:49.707003 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-49784593-9688-4159-aeed-6b72bc6cb18f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:49.707426 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-49784593-9688-4159-aeed-6b72bc6cb18f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:49.799172 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-49784593-9688-4159-aeed-6b72bc6cb18f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28197 microversion: 2.20 time: 0.103987 Aug 27 04:39:49.799762 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 457/913] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:39:49 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:39:49.853882 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-4c1ec4df-b1ab-4682-9dcb-c94c4c2166ec tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:49.854501 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-4c1ec4df-b1ab-4682-9dcb-c94c4c2166ec tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:49.860714 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4c1ec4df-b1ab-4682-9dcb-c94c4c2166ec tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:49.861167 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4c1ec4df-b1ab-4682-9dcb-c94c4c2166ec tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:49.861932 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4c1ec4df-b1ab-4682-9dcb-c94c4c2166ec tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:49.862372 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4c1ec4df-b1ab-4682-9dcb-c94c4c2166ec tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:49.978581 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-4c1ec4df-b1ab-4682-9dcb-c94c4c2166ec tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:49.986070 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-4c1ec4df-b1ab-4682-9dcb-c94c4c2166ec tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1567 microversion: 2.1 time: 0.136317 Aug 27 04:39:49.986637 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 457/914] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:39:49 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1567 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:50.041518 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-8c2531cf-aba4-4871-b094-873c243c5660 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:50.042216 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-8c2531cf-aba4-4871-b094-873c243c5660 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:50.048715 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8c2531cf-aba4-4871-b094-873c243c5660 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:50.049162 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8c2531cf-aba4-4871-b094-873c243c5660 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:50.049964 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8c2531cf-aba4-4871-b094-873c243c5660 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:50.050404 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8c2531cf-aba4-4871-b094-873c243c5660 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:50.170624 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-8c2531cf-aba4-4871-b094-873c243c5660 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:50.178116 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-8c2531cf-aba4-4871-b094-873c243c5660 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1674 microversion: 2.1 time: 0.141180 Aug 27 04:39:50.178665 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 458/915] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:39:50 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1674 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:50.811132 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-b8b443e4-38df-4aab-861d-50843f098894 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:50.812138 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-b8b443e4-38df-4aab-861d-50843f098894 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:50.818352 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b8b443e4-38df-4aab-861d-50843f098894 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:50.818807 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b8b443e4-38df-4aab-861d-50843f098894 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:50.819574 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b8b443e4-38df-4aab-861d-50843f098894 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:50.820600 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b8b443e4-38df-4aab-861d-50843f098894 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:50.919267 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-b8b443e4-38df-4aab-861d-50843f098894 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28197 microversion: 2.20 time: 0.111622 Aug 27 04:39:50.920094 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 458/916] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:39:50 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:39:51.006863 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-198ed9b8-a7ed-41d6-96c8-b2c8d1b65db9 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:51.008104 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-198ed9b8-a7ed-41d6-96c8-b2c8d1b65db9 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:51.013863 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-198ed9b8-a7ed-41d6-96c8-b2c8d1b65db9 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:51.014309 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-198ed9b8-a7ed-41d6-96c8-b2c8d1b65db9 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:51.015074 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-198ed9b8-a7ed-41d6-96c8-b2c8d1b65db9 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:51.015507 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-198ed9b8-a7ed-41d6-96c8-b2c8d1b65db9 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:51.195635 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-f2369e77-3c1e-41eb-9769-878f68ff77e8 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:51.196375 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-f2369e77-3c1e-41eb-9769-878f68ff77e8 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:51.202978 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f2369e77-3c1e-41eb-9769-878f68ff77e8 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:51.203230 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f2369e77-3c1e-41eb-9769-878f68ff77e8 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:51.204025 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f2369e77-3c1e-41eb-9769-878f68ff77e8 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:51.204463 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f2369e77-3c1e-41eb-9769-878f68ff77e8 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:51.249654 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-198ed9b8-a7ed-41d6-96c8-b2c8d1b65db9 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:51.263194 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-198ed9b8-a7ed-41d6-96c8-b2c8d1b65db9 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1567 microversion: 2.1 time: 0.259882 Aug 27 04:39:51.264142 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 459/917] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:39:51 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1567 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:51.333162 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-f2369e77-3c1e-41eb-9769-878f68ff77e8 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:51.343768 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-f2369e77-3c1e-41eb-9769-878f68ff77e8 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1674 microversion: 2.1 time: 0.152308 Aug 27 04:39:51.344805 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 459/918] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:39:51 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:51.763355 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [req-90fe6b1e-5bf8-495c-b1a5-5162708638fe req-57da45c2-3c9d-499e-9462-cc52d1a24874 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5598e9e1-bc44-4831-be1a-f478deba899b", "name": "network-vif-deleted", "tag": "f8a58c4d-0881-4c48-9ebe-4070da2b40d9"}]} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:51.764956 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:39:51.764956 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: warnings.warn(msg) Aug 27 04:39:51.772223 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-90fe6b1e-5bf8-495c-b1a5-5162708638fe req-57da45c2-3c9d-499e-9462-cc52d1a24874 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:51.772669 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-90fe6b1e-5bf8-495c-b1a5-5162708638fe req-57da45c2-3c9d-499e-9462-cc52d1a24874 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:51.784260 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.compute.server_external_events [req-90fe6b1e-5bf8-495c-b1a5-5162708638fe req-57da45c2-3c9d-499e-9462-cc52d1a24874 service nova] Creating event network-vif-deleted:f8a58c4d-0881-4c48-9ebe-4070da2b40d9 for instance 5598e9e1-bc44-4831-be1a-f478deba899b on hv-cinder-80403 Aug 27 04:39:51.789959 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [req-90fe6b1e-5bf8-495c-b1a5-5162708638fe req-57da45c2-3c9d-499e-9462-cc52d1a24874 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030224 Aug 27 04:39:51.790732 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 460/919] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:39:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:39:51.931151 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-5ab0a86b-f020-4a2b-86dd-a9294b4c5d3c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:51.932221 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-5ab0a86b-f020-4a2b-86dd-a9294b4c5d3c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:51.939252 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5ab0a86b-f020-4a2b-86dd-a9294b4c5d3c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:51.939853 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5ab0a86b-f020-4a2b-86dd-a9294b4c5d3c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:51.940689 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5ab0a86b-f020-4a2b-86dd-a9294b4c5d3c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:51.941307 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5ab0a86b-f020-4a2b-86dd-a9294b4c5d3c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:52.281060 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-6ffe7532-2e09-4625-9108-56f008db26ea tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:52.281754 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-6ffe7532-2e09-4625-9108-56f008db26ea tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:52.287706 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6ffe7532-2e09-4625-9108-56f008db26ea tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:52.288195 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6ffe7532-2e09-4625-9108-56f008db26ea tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:52.288985 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6ffe7532-2e09-4625-9108-56f008db26ea tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:52.289420 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6ffe7532-2e09-4625-9108-56f008db26ea tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:52.413823 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-6ffe7532-2e09-4625-9108-56f008db26ea tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:52.421198 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-6ffe7532-2e09-4625-9108-56f008db26ea tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1567 microversion: 2.1 time: 0.144223 Aug 27 04:39:52.423303 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 461/920] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:39:52 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1567 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:39:52.426118 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-ad82c50c-4065-4bae-9945-0a80d01c3be1 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:52.426717 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-ad82c50c-4065-4bae-9945-0a80d01c3be1 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:52.433324 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ad82c50c-4065-4bae-9945-0a80d01c3be1 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:52.433774 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ad82c50c-4065-4bae-9945-0a80d01c3be1 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:52.435052 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ad82c50c-4065-4bae-9945-0a80d01c3be1 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:52.435052 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ad82c50c-4065-4bae-9945-0a80d01c3be1 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:52.465493 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ad82c50c-4065-4bae-9945-0a80d01c3be1 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:52.465946 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ad82c50c-4065-4bae-9945-0a80d01c3be1 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:52.466392 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.objects.instance [None req-ad82c50c-4065-4bae-9945-0a80d01c3be1 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lazy-loading 'fault' on Instance uuid 5598e9e1-bc44-4831-be1a-f478deba899b {{(pid=108971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:39:52.508725 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-ad82c50c-4065-4bae-9945-0a80d01c3be1 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:52.516018 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-ad82c50c-4065-4bae-9945-0a80d01c3be1 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1328 microversion: 2.1 time: 0.093297 Aug 27 04:39:52.516592 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 462/921] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:39:52 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1328 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:53.438362 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-b127bd77-2411-4a1a-a888-9839c2e57e03 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:53.438998 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-b127bd77-2411-4a1a-a888-9839c2e57e03 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:53.445801 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b127bd77-2411-4a1a-a888-9839c2e57e03 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:53.446243 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b127bd77-2411-4a1a-a888-9839c2e57e03 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:53.447002 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b127bd77-2411-4a1a-a888-9839c2e57e03 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:53.447433 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b127bd77-2411-4a1a-a888-9839c2e57e03 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:53.564882 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-b127bd77-2411-4a1a-a888-9839c2e57e03 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:53.572847 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-b127bd77-2411-4a1a-a888-9839c2e57e03 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1567 microversion: 2.1 time: 0.138150 Aug 27 04:39:53.573417 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 463/922] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:39:53 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1567 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:39:53.577593 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-27521ee9-b2f8-4cbb-89e4-35b736937ea4 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:53.578200 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-27521ee9-b2f8-4cbb-89e4-35b736937ea4 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:53.583828 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-27521ee9-b2f8-4cbb-89e4-35b736937ea4 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:53.584312 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-27521ee9-b2f8-4cbb-89e4-35b736937ea4 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:53.585070 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-27521ee9-b2f8-4cbb-89e4-35b736937ea4 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:53.586135 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-27521ee9-b2f8-4cbb-89e4-35b736937ea4 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:53.614756 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-27521ee9-b2f8-4cbb-89e4-35b736937ea4 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:53.615196 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-27521ee9-b2f8-4cbb-89e4-35b736937ea4 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:53.615637 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.objects.instance [None req-27521ee9-b2f8-4cbb-89e4-35b736937ea4 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lazy-loading 'fault' on Instance uuid 5598e9e1-bc44-4831-be1a-f478deba899b {{(pid=108971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:39:53.653753 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-27521ee9-b2f8-4cbb-89e4-35b736937ea4 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:53.660807 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-27521ee9-b2f8-4cbb-89e4-35b736937ea4 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1328 microversion: 2.1 time: 0.086468 Aug 27 04:39:53.661371 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 464/923] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:39:53 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1328 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:54.589504 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-026aaa71-4962-41a4-82c7-aa2e2ce48ca1 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:54.590122 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-026aaa71-4962-41a4-82c7-aa2e2ce48ca1 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:54.595879 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-026aaa71-4962-41a4-82c7-aa2e2ce48ca1 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:54.596353 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-026aaa71-4962-41a4-82c7-aa2e2ce48ca1 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:54.597107 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-026aaa71-4962-41a4-82c7-aa2e2ce48ca1 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:54.597537 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-026aaa71-4962-41a4-82c7-aa2e2ce48ca1 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:54.717222 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-026aaa71-4962-41a4-82c7-aa2e2ce48ca1 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:54.727394 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-026aaa71-4962-41a4-82c7-aa2e2ce48ca1 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1567 microversion: 2.1 time: 0.141579 Aug 27 04:39:54.728361 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 465/924] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:39:54 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1567 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:39:54.732928 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-2a58335b-325c-4cdf-ab71-ee4de7fcbd11 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:54.733526 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-2a58335b-325c-4cdf-ab71-ee4de7fcbd11 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:54.739291 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-2a58335b-325c-4cdf-ab71-ee4de7fcbd11 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:54.739730 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-2a58335b-325c-4cdf-ab71-ee4de7fcbd11 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:54.740546 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-2a58335b-325c-4cdf-ab71-ee4de7fcbd11 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:54.740978 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-2a58335b-325c-4cdf-ab71-ee4de7fcbd11 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:54.769796 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-2a58335b-325c-4cdf-ab71-ee4de7fcbd11 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:54.770237 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-2a58335b-325c-4cdf-ab71-ee4de7fcbd11 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:54.770678 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.objects.instance [None req-2a58335b-325c-4cdf-ab71-ee4de7fcbd11 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lazy-loading 'fault' on Instance uuid 5598e9e1-bc44-4831-be1a-f478deba899b {{(pid=108971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:39:54.808917 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-2a58335b-325c-4cdf-ab71-ee4de7fcbd11 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:54.816014 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-2a58335b-325c-4cdf-ab71-ee4de7fcbd11 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1328 microversion: 2.1 time: 0.086695 Aug 27 04:39:54.816621 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 466/925] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:39:54 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1328 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:55.745042 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-d2ae1ae5-617e-4630-8a17-4e694db5b634 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:55.746253 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-d2ae1ae5-617e-4630-8a17-4e694db5b634 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:55.752181 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d2ae1ae5-617e-4630-8a17-4e694db5b634 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:55.752628 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d2ae1ae5-617e-4630-8a17-4e694db5b634 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:55.753387 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d2ae1ae5-617e-4630-8a17-4e694db5b634 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:55.753818 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d2ae1ae5-617e-4630-8a17-4e694db5b634 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:55.870710 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-d2ae1ae5-617e-4630-8a17-4e694db5b634 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:55.877945 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-d2ae1ae5-617e-4630-8a17-4e694db5b634 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1567 microversion: 2.1 time: 0.136601 Aug 27 04:39:55.878513 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 467/926] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:39:55 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1567 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:39:55.882793 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-56fdf5fa-ae16-41a1-838b-ecd9d1563626 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:55.883389 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-56fdf5fa-ae16-41a1-838b-ecd9d1563626 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:55.888677 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-56fdf5fa-ae16-41a1-838b-ecd9d1563626 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:55.889121 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-56fdf5fa-ae16-41a1-838b-ecd9d1563626 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:55.889877 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-56fdf5fa-ae16-41a1-838b-ecd9d1563626 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:55.890313 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-56fdf5fa-ae16-41a1-838b-ecd9d1563626 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:55.919332 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-56fdf5fa-ae16-41a1-838b-ecd9d1563626 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:55.919778 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-56fdf5fa-ae16-41a1-838b-ecd9d1563626 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:55.920245 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.objects.instance [None req-56fdf5fa-ae16-41a1-838b-ecd9d1563626 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lazy-loading 'fault' on Instance uuid 5598e9e1-bc44-4831-be1a-f478deba899b {{(pid=108971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:39:55.959585 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-56fdf5fa-ae16-41a1-838b-ecd9d1563626 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:55.966993 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-56fdf5fa-ae16-41a1-838b-ecd9d1563626 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1328 microversion: 2.1 time: 0.087456 Aug 27 04:39:55.967567 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 468/927] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:39:55 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1328 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:56.894638 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-f5d33f06-dbc0-4fda-80db-bfb5b0120fd7 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:56.895247 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-f5d33f06-dbc0-4fda-80db-bfb5b0120fd7 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:56.901059 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f5d33f06-dbc0-4fda-80db-bfb5b0120fd7 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:56.901504 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f5d33f06-dbc0-4fda-80db-bfb5b0120fd7 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:56.902269 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f5d33f06-dbc0-4fda-80db-bfb5b0120fd7 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:56.902709 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f5d33f06-dbc0-4fda-80db-bfb5b0120fd7 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:57.022040 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-f5d33f06-dbc0-4fda-80db-bfb5b0120fd7 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:57.029315 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-f5d33f06-dbc0-4fda-80db-bfb5b0120fd7 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1567 microversion: 2.1 time: 0.138365 Aug 27 04:39:57.029877 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 469/928] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:39:56 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1567 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:39:57.034044 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-cd9a6f22-4720-4f52-9fc3-bbc66cb248e9 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:57.034589 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-cd9a6f22-4720-4f52-9fc3-bbc66cb248e9 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:57.039891 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cd9a6f22-4720-4f52-9fc3-bbc66cb248e9 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:57.040376 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cd9a6f22-4720-4f52-9fc3-bbc66cb248e9 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:57.041138 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cd9a6f22-4720-4f52-9fc3-bbc66cb248e9 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:57.041575 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cd9a6f22-4720-4f52-9fc3-bbc66cb248e9 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:57.071389 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cd9a6f22-4720-4f52-9fc3-bbc66cb248e9 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:57.071824 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cd9a6f22-4720-4f52-9fc3-bbc66cb248e9 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:57.072292 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.objects.instance [None req-cd9a6f22-4720-4f52-9fc3-bbc66cb248e9 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lazy-loading 'fault' on Instance uuid 5598e9e1-bc44-4831-be1a-f478deba899b {{(pid=108971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:39:57.111105 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-cd9a6f22-4720-4f52-9fc3-bbc66cb248e9 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:57.118807 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-cd9a6f22-4720-4f52-9fc3-bbc66cb248e9 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1328 microversion: 2.1 time: 0.088001 Aug 27 04:39:57.119368 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 470/929] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:39:57 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1328 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:57.908562 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-5ab0a86b-f020-4a2b-86dd-a9294b4c5d3c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28197 microversion: 2.20 time: 5.981134 Aug 27 04:39:57.909486 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 460/930] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:39:51 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28197 bytes in 5983 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:39:58.045959 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-cb4dc986-cdd2-490e-a442-dc07941cbee0 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:58.046478 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-cb4dc986-cdd2-490e-a442-dc07941cbee0 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:58.052718 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cb4dc986-cdd2-490e-a442-dc07941cbee0 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:58.053154 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cb4dc986-cdd2-490e-a442-dc07941cbee0 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:58.053901 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cb4dc986-cdd2-490e-a442-dc07941cbee0 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:58.054325 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cb4dc986-cdd2-490e-a442-dc07941cbee0 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:58.137492 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-4a9d14d8-e213-4d1d-b598-a7bad799a1f0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:58.138465 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-4a9d14d8-e213-4d1d-b598-a7bad799a1f0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:58.145243 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4a9d14d8-e213-4d1d-b598-a7bad799a1f0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:58.145691 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4a9d14d8-e213-4d1d-b598-a7bad799a1f0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:58.146467 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4a9d14d8-e213-4d1d-b598-a7bad799a1f0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:58.146908 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4a9d14d8-e213-4d1d-b598-a7bad799a1f0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:58.171823 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-cb4dc986-cdd2-490e-a442-dc07941cbee0 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:58.177281 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4a9d14d8-e213-4d1d-b598-a7bad799a1f0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:58.177730 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4a9d14d8-e213-4d1d-b598-a7bad799a1f0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:58.178179 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.objects.instance [None req-4a9d14d8-e213-4d1d-b598-a7bad799a1f0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lazy-loading 'fault' on Instance uuid 5598e9e1-bc44-4831-be1a-f478deba899b {{(pid=108970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:39:58.179157 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-cb4dc986-cdd2-490e-a442-dc07941cbee0 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1567 microversion: 2.1 time: 0.136856 Aug 27 04:39:58.179750 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 471/931] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:39:58 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1567 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:39:58.221713 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-4a9d14d8-e213-4d1d-b598-a7bad799a1f0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:58.228908 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-4a9d14d8-e213-4d1d-b598-a7bad799a1f0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 200 len: 1328 microversion: 2.1 time: 0.096903 Aug 27 04:39:58.229484 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 461/932] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:39:58 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 1328 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:39:58.920265 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-648bafde-62da-4e76-a877-1bf85d2ffc85 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:39:58.921168 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-648bafde-62da-4e76-a877-1bf85d2ffc85 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:58.927032 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-648bafde-62da-4e76-a877-1bf85d2ffc85 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:58.927476 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-648bafde-62da-4e76-a877-1bf85d2ffc85 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:58.928284 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-648bafde-62da-4e76-a877-1bf85d2ffc85 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:58.929318 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-648bafde-62da-4e76-a877-1bf85d2ffc85 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:59.031548 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-648bafde-62da-4e76-a877-1bf85d2ffc85 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28197 microversion: 2.20 time: 0.114271 Aug 27 04:39:59.032260 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 472/933] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:39:58 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:39:59.195978 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-b009a4a7-3522-4aff-ba94-f4fe6430cd14 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:59.196520 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-b009a4a7-3522-4aff-ba94-f4fe6430cd14 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:59.202780 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b009a4a7-3522-4aff-ba94-f4fe6430cd14 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:59.203235 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b009a4a7-3522-4aff-ba94-f4fe6430cd14 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:59.204024 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b009a4a7-3522-4aff-ba94-f4fe6430cd14 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:59.204470 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b009a4a7-3522-4aff-ba94-f4fe6430cd14 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:59.245849 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-4cf53328-bed4-44ff-afbf-91b5ac54b34a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:59.246548 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-4cf53328-bed4-44ff-afbf-91b5ac54b34a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:39:59.253376 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-4cf53328-bed4-44ff-afbf-91b5ac54b34a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:59.253821 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-4cf53328-bed4-44ff-afbf-91b5ac54b34a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:59.254593 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-4cf53328-bed4-44ff-afbf-91b5ac54b34a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:39:59.255026 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-4cf53328-bed4-44ff-afbf-91b5ac54b34a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:39:59.268389 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.wsgi [None req-4cf53328-bed4-44ff-afbf-91b5ac54b34a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] HTTP exception thrown: Instance 5598e9e1-bc44-4831-be1a-f478deba899b could not be found. Aug 27 04:39:59.268983 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-4cf53328-bed4-44ff-afbf-91b5ac54b34a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Returning 404 to user: Instance 5598e9e1-bc44-4831-be1a-f478deba899b could not be found. {{(pid=108971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:39:59.269810 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-4cf53328-bed4-44ff-afbf-91b5ac54b34a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 404 len: 111 microversion: 2.1 time: 0.027948 Aug 27 04:39:59.270347 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 473/934] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:39:59 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 04:39:59.278863 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-ff134e5e-00cd-4561-b76b-08d1ea2d137a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '.version_select at 0x7f20786b7a60>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:39:59.321213 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-ff134e5e-00cd-4561-b76b-08d1ea2d137a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1446029779" status: 202 len: 0 microversion: 2.1 time: 0.045753 Aug 27 04:39:59.325756 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 474/935] 10.222.0.53 () {58 vars in 1221 bytes} [Fri Aug 27 04:39:59 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1446029779 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:39:59.328032 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-b009a4a7-3522-4aff-ba94-f4fe6430cd14 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:39:59.336130 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-b009a4a7-3522-4aff-ba94-f4fe6430cd14 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1567 microversion: 2.1 time: 0.143826 Aug 27 04:39:59.336688 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 462/936] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:39:59 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1567 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:00.003339 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-e722aea1-f25a-4643-920b-f31809a74d13 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'create', calling method: .version_select at 0x7f20786b7940>, body: {"keypair": {"name": "tempest-keypair-1473639690"}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:00.030763 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.quota [None req-e722aea1-f25a-4643-920b-f31809a74d13 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Getting quotas for project 73010213c0b945979b5a337586b82752. Resources: {'key_pairs'} {{(pid=108971) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:40:00.034613 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.quota [None req-e722aea1-f25a-4643-920b-f31809a74d13 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Getting quotas for user 54782c38800c424ca31457987a9d771b and project 73010213c0b945979b5a337586b82752. Resources: {'key_pairs'} {{(pid=108971) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:40:00.044074 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-1144524a-2c93-42bb-a0b6-b68ce2c74eb0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:00.044989 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-1144524a-2c93-42bb-a0b6-b68ce2c74eb0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:00.051334 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1144524a-2c93-42bb-a0b6-b68ce2c74eb0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:00.051783 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1144524a-2c93-42bb-a0b6-b68ce2c74eb0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:00.052589 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1144524a-2c93-42bb-a0b6-b68ce2c74eb0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:00.053026 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1144524a-2c93-42bb-a0b6-b68ce2c74eb0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:00.149276 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-1144524a-2c93-42bb-a0b6-b68ce2c74eb0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28197 microversion: 2.20 time: 0.108716 Aug 27 04:40:00.150282 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 463/937] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:40:00 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:40:00.240196 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.quota [None req-e722aea1-f25a-4643-920b-f31809a74d13 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Getting quotas for project 73010213c0b945979b5a337586b82752. Resources: {'key_pairs'} {{(pid=108971) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:40:00.244514 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.quota [None req-e722aea1-f25a-4643-920b-f31809a74d13 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Getting quotas for user 54782c38800c424ca31457987a9d771b and project 73010213c0b945979b5a337586b82752. Resources: {'key_pairs'} {{(pid=108971) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:40:00.258246 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-e722aea1-f25a-4643-920b-f31809a74d13 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.258831 Aug 27 04:40:00.258821 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 475/938] 10.222.0.53 () {60 vars in 1158 bytes} [Fri Aug 27 04:39:59 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:00.353822 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-2b59f250-a9db-4722-8d80-efde09c9112e tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:00.354546 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-2b59f250-a9db-4722-8d80-efde09c9112e tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:00.361630 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2b59f250-a9db-4722-8d80-efde09c9112e tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:00.362078 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2b59f250-a9db-4722-8d80-efde09c9112e tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:00.362861 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2b59f250-a9db-4722-8d80-efde09c9112e tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:00.363292 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2b59f250-a9db-4722-8d80-efde09c9112e tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:00.490869 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-2b59f250-a9db-4722-8d80-efde09c9112e tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:00.498814 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-2b59f250-a9db-4722-8d80-efde09c9112e tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1567 microversion: 2.1 time: 0.149562 Aug 27 04:40:00.499354 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 464/939] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:40:00 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:01.161528 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-e0b90875-7bb9-428d-9c48-a0bf954919d0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:01.162576 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-e0b90875-7bb9-428d-9c48-a0bf954919d0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:01.169360 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e0b90875-7bb9-428d-9c48-a0bf954919d0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:01.169950 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e0b90875-7bb9-428d-9c48-a0bf954919d0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:01.170797 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e0b90875-7bb9-428d-9c48-a0bf954919d0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:01.171311 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e0b90875-7bb9-428d-9c48-a0bf954919d0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:01.267582 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-e0b90875-7bb9-428d-9c48-a0bf954919d0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28197 microversion: 2.20 time: 0.109767 Aug 27 04:40:01.268308 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 476/940] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:40:01 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:40:01.500086 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-2373bbca-1939-4aba-b3d6-53a6ce5c4af2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1880816546", "imageRef": "9356e2fa-e55b-41d9-9ca4-53393f2d79fd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a919ac5d-841a-4ae2-b353-26d1ed741c31"}], "security_groups": [{"name": "tempest-securitygroup--94461144"}], "key_name": "tempest-keypair-1473639690", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:01.515815 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-ae3e5050-d305-4b97-986e-cb741ad4359d tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:01.516538 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-ae3e5050-d305-4b97-986e-cb741ad4359d tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:01.523095 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ae3e5050-d305-4b97-986e-cb741ad4359d tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:01.524254 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ae3e5050-d305-4b97-986e-cb741ad4359d tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:01.524546 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ae3e5050-d305-4b97-986e-cb741ad4359d tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:01.525015 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ae3e5050-d305-4b97-986e-cb741ad4359d tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:01.593324 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.network.neutron [None req-2373bbca-1939-4aba-b3d6-53a6ce5c4af2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] validate_networks() for [('a919ac5d-841a-4ae2-b353-26d1ed741c31', None, None, None, None, None)] {{(pid=108970) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 04:40:01.651464 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-ae3e5050-d305-4b97-986e-cb741ad4359d tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:01.659764 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-ae3e5050-d305-4b97-986e-cb741ad4359d tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1567 microversion: 2.1 time: 0.147800 Aug 27 04:40:01.663948 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 477/941] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:40:01 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:40:01.951650 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.virt.hardware [None req-2373bbca-1939-4aba-b3d6-53a6ce5c4af2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Flavor limits 0:0:0 {{(pid=108970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:40:01.952111 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.virt.hardware [None req-2373bbca-1939-4aba-b3d6-53a6ce5c4af2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Image limits 0:0:0 {{(pid=108970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:40:01.952595 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.virt.hardware [None req-2373bbca-1939-4aba-b3d6-53a6ce5c4af2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Flavor pref 0:0:0 {{(pid=108970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:40:01.953059 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.virt.hardware [None req-2373bbca-1939-4aba-b3d6-53a6ce5c4af2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Image pref 0:0:0 {{(pid=108970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:40:01.953472 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.virt.hardware [None req-2373bbca-1939-4aba-b3d6-53a6ce5c4af2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:40:01.962367 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2373bbca-1939-4aba-b3d6-53a6ce5c4af2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:01.962756 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2373bbca-1939-4aba-b3d6-53a6ce5c4af2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:01.963568 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2373bbca-1939-4aba-b3d6-53a6ce5c4af2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:01.964022 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2373bbca-1939-4aba-b3d6-53a6ce5c4af2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:01.980448 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.quota [None req-2373bbca-1939-4aba-b3d6-53a6ce5c4af2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Getting quotas for project 73010213c0b945979b5a337586b82752. Resources: {'ram', 'cores', 'instances'} {{(pid=108970) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:40:01.984568 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.quota [None req-2373bbca-1939-4aba-b3d6-53a6ce5c4af2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Getting quotas for user 54782c38800c424ca31457987a9d771b and project 73010213c0b945979b5a337586b82752. Resources: {'ram', 'cores', 'instances'} {{(pid=108970) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:40:01.995651 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-2373bbca-1939-4aba-b3d6-53a6ce5c4af2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Going to run 1 instances... {{(pid=108970) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 04:40:01.997984 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-2373bbca-1939-4aba-b3d6-53a6ce5c4af2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9356e2fa-e55b-41d9-9ca4-53393f2d79fd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 04:40:02.043383 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-2373bbca-1939-4aba-b3d6-53a6ce5c4af2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.547323 Aug 27 04:40:02.044059 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 465/942] 10.222.0.53 () {60 vars in 1147 bytes} [Fri Aug 27 04:40:01 2021] POST /compute/v2.1/servers => generated 400 bytes in 549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:40:02.053861 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-d777baa8-e4b6-4a2f-8d76-b07afbb36922 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:02.054475 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-d777baa8-e4b6-4a2f-8d76-b07afbb36922 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:02.106731 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-d777baa8-e4b6-4a2f-8d76-b07afbb36922 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:02.114374 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-d777baa8-e4b6-4a2f-8d76-b07afbb36922 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05" status: 200 len: 1238 microversion: 2.1 time: 0.064210 Aug 27 04:40:02.118779 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 478/943] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:40:02 2021] GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05 => generated 1238 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:02.281660 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-af5c9060-2a4c-4525-9b1e-0586ac08a550 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:02.282933 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-af5c9060-2a4c-4525-9b1e-0586ac08a550 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:02.291075 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-af5c9060-2a4c-4525-9b1e-0586ac08a550 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:02.292073 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-af5c9060-2a4c-4525-9b1e-0586ac08a550 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:02.292972 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-af5c9060-2a4c-4525-9b1e-0586ac08a550 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:02.293490 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-af5c9060-2a4c-4525-9b1e-0586ac08a550 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:02.397924 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-af5c9060-2a4c-4525-9b1e-0586ac08a550 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28197 microversion: 2.20 time: 0.120645 Aug 27 04:40:02.398602 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 466/944] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:40:02 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:40:02.678227 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-77f94123-ea86-4569-86b9-51871f7648c7 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:02.678753 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-77f94123-ea86-4569-86b9-51871f7648c7 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:02.686886 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-77f94123-ea86-4569-86b9-51871f7648c7 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:02.687336 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-77f94123-ea86-4569-86b9-51871f7648c7 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:02.688183 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-77f94123-ea86-4569-86b9-51871f7648c7 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:02.688843 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-77f94123-ea86-4569-86b9-51871f7648c7 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:02.809245 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-77f94123-ea86-4569-86b9-51871f7648c7 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:02.816675 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-77f94123-ea86-4569-86b9-51871f7648c7 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1567 microversion: 2.1 time: 0.142195 Aug 27 04:40:02.817247 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 479/945] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:40:02 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1567 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:40:03.132909 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-fa077e42-6569-4231-9cef-40a2b9ac3e30 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:03.133625 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-fa077e42-6569-4231-9cef-40a2b9ac3e30 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:03.140647 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fa077e42-6569-4231-9cef-40a2b9ac3e30 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:03.141109 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fa077e42-6569-4231-9cef-40a2b9ac3e30 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:03.141893 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fa077e42-6569-4231-9cef-40a2b9ac3e30 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:03.142337 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fa077e42-6569-4231-9cef-40a2b9ac3e30 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:03.205375 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-fa077e42-6569-4231-9cef-40a2b9ac3e30 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:03.212657 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-fa077e42-6569-4231-9cef-40a2b9ac3e30 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05" status: 200 len: 1290 microversion: 2.1 time: 0.084421 Aug 27 04:40:03.213479 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 467/946] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:40:03 2021] GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05 => generated 1290 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:03.410125 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-075e7673-db5a-4b6e-8bcf-5006c76a1fc2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:03.411163 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-075e7673-db5a-4b6e-8bcf-5006c76a1fc2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:03.417543 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-075e7673-db5a-4b6e-8bcf-5006c76a1fc2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:03.418065 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-075e7673-db5a-4b6e-8bcf-5006c76a1fc2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:03.418905 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-075e7673-db5a-4b6e-8bcf-5006c76a1fc2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:03.419414 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-075e7673-db5a-4b6e-8bcf-5006c76a1fc2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:03.580192 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-075e7673-db5a-4b6e-8bcf-5006c76a1fc2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28197 microversion: 2.20 time: 0.173878 Aug 27 04:40:03.580841 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 480/947] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:40:03 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28197 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:40:03.834621 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-325345eb-406e-423a-8745-e141ebbb1579 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:03.835758 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-325345eb-406e-423a-8745-e141ebbb1579 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:03.841740 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-325345eb-406e-423a-8745-e141ebbb1579 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:03.842191 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-325345eb-406e-423a-8745-e141ebbb1579 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:03.842957 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-325345eb-406e-423a-8745-e141ebbb1579 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:03.843386 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-325345eb-406e-423a-8745-e141ebbb1579 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:04.022327 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-325345eb-406e-423a-8745-e141ebbb1579 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:04.030304 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-325345eb-406e-423a-8745-e141ebbb1579 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1567 microversion: 2.1 time: 0.199431 Aug 27 04:40:04.031073 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 468/948] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:40:03 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1567 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:04.230891 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-fb95f5b2-8c6b-454f-a244-7eaf2fd96735 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:04.231819 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-fb95f5b2-8c6b-454f-a244-7eaf2fd96735 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:04.239541 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-fb95f5b2-8c6b-454f-a244-7eaf2fd96735 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:04.240397 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-fb95f5b2-8c6b-454f-a244-7eaf2fd96735 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:04.241224 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-fb95f5b2-8c6b-454f-a244-7eaf2fd96735 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:04.241944 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-fb95f5b2-8c6b-454f-a244-7eaf2fd96735 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:04.372896 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-fb95f5b2-8c6b-454f-a244-7eaf2fd96735 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:04.380484 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-fb95f5b2-8c6b-454f-a244-7eaf2fd96735 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05" status: 200 len: 1362 microversion: 2.1 time: 0.153609 Aug 27 04:40:04.381043 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 481/949] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:40:04 2021] GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:04.592776 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-6306d429-7b0c-4ab5-8e47-16f37d3d439f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:04.593700 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-6306d429-7b0c-4ab5-8e47-16f37d3d439f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:04.600183 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6306d429-7b0c-4ab5-8e47-16f37d3d439f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:04.601215 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6306d429-7b0c-4ab5-8e47-16f37d3d439f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:04.601994 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6306d429-7b0c-4ab5-8e47-16f37d3d439f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:04.602430 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6306d429-7b0c-4ab5-8e47-16f37d3d439f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:04.716024 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-6306d429-7b0c-4ab5-8e47-16f37d3d439f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28197 microversion: 2.20 time: 0.127557 Aug 27 04:40:04.717046 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 469/950] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:40:04 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:40:04.874438 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [req-f09c542f-7447-4a96-b2a6-187c096e8977 req-f841e99b-260e-449a-98da-eeef0db29e78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d90eb911-b246-4928-ac32-cb9eb412ac05", "tag": "be02021d-efc7-490f-b112-ba663b0a0f36"}]} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:04.880332 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:40:04.880332 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: warnings.warn(msg) Aug 27 04:40:04.888741 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-f09c542f-7447-4a96-b2a6-187c096e8977 req-f841e99b-260e-449a-98da-eeef0db29e78 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:04.889400 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-f09c542f-7447-4a96-b2a6-187c096e8977 req-f841e99b-260e-449a-98da-eeef0db29e78 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:04.901792 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.compute.server_external_events [req-f09c542f-7447-4a96-b2a6-187c096e8977 req-f841e99b-260e-449a-98da-eeef0db29e78 service nova] Creating event network-changed:be02021d-efc7-490f-b112-ba663b0a0f36 for instance d90eb911-b246-4928-ac32-cb9eb412ac05 on hv-cinder-80403 Aug 27 04:40:04.907528 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [req-f09c542f-7447-4a96-b2a6-187c096e8977 req-f841e99b-260e-449a-98da-eeef0db29e78 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036502 Aug 27 04:40:04.908056 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 482/951] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:40:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:40:05.147978 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-23b5496f-742a-45a8-90e0-8c99f93ff4b6 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:05.148712 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-23b5496f-742a-45a8-90e0-8c99f93ff4b6 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:05.155124 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-23b5496f-742a-45a8-90e0-8c99f93ff4b6 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:05.155566 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-23b5496f-742a-45a8-90e0-8c99f93ff4b6 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:05.156367 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-23b5496f-742a-45a8-90e0-8c99f93ff4b6 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:05.156796 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-23b5496f-742a-45a8-90e0-8c99f93ff4b6 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:05.332561 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-23b5496f-742a-45a8-90e0-8c99f93ff4b6 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:05.340042 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-23b5496f-742a-45a8-90e0-8c99f93ff4b6 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1567 microversion: 2.1 time: 0.296732 Aug 27 04:40:05.340612 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 470/952] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:40:05 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1567 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:05.399382 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-3e3f7bfa-6072-4b4a-981e-3407e6851484 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:05.400235 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-3e3f7bfa-6072-4b4a-981e-3407e6851484 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:05.406519 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3e3f7bfa-6072-4b4a-981e-3407e6851484 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:05.406977 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3e3f7bfa-6072-4b4a-981e-3407e6851484 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:05.407727 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3e3f7bfa-6072-4b4a-981e-3407e6851484 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:05.408195 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3e3f7bfa-6072-4b4a-981e-3407e6851484 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:05.538960 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-3e3f7bfa-6072-4b4a-981e-3407e6851484 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:05.546140 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-3e3f7bfa-6072-4b4a-981e-3407e6851484 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05" status: 200 len: 1362 microversion: 2.1 time: 0.151272 Aug 27 04:40:05.546701 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 483/953] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:40:05 2021] GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:05.728062 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-eca16d1b-ddd8-4195-b755-c2426e9e8d5b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:05.728946 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-eca16d1b-ddd8-4195-b755-c2426e9e8d5b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:05.735047 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-eca16d1b-ddd8-4195-b755-c2426e9e8d5b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:05.735510 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-eca16d1b-ddd8-4195-b755-c2426e9e8d5b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:05.736329 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-eca16d1b-ddd8-4195-b755-c2426e9e8d5b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:05.736775 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-eca16d1b-ddd8-4195-b755-c2426e9e8d5b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:06.357642 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-8ae1d044-dabe-490b-a0c9-050dad16ac9f tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:06.358318 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-8ae1d044-dabe-490b-a0c9-050dad16ac9f tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:06.365208 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8ae1d044-dabe-490b-a0c9-050dad16ac9f tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:06.365657 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8ae1d044-dabe-490b-a0c9-050dad16ac9f tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:06.366465 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8ae1d044-dabe-490b-a0c9-050dad16ac9f tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:06.367001 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8ae1d044-dabe-490b-a0c9-050dad16ac9f tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:06.485379 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-8ae1d044-dabe-490b-a0c9-050dad16ac9f tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:06.492671 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-8ae1d044-dabe-490b-a0c9-050dad16ac9f tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1567 microversion: 2.1 time: 0.139293 Aug 27 04:40:06.493229 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 484/954] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:40:06 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1567 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:06.562337 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-8d9120cb-2346-46f1-a6d7-751611eb6a05 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:06.562935 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-8d9120cb-2346-46f1-a6d7-751611eb6a05 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:06.568732 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8d9120cb-2346-46f1-a6d7-751611eb6a05 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:06.569825 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8d9120cb-2346-46f1-a6d7-751611eb6a05 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:06.570582 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8d9120cb-2346-46f1-a6d7-751611eb6a05 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:06.571044 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8d9120cb-2346-46f1-a6d7-751611eb6a05 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:06.687561 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-8d9120cb-2346-46f1-a6d7-751611eb6a05 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:06.695130 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-8d9120cb-2346-46f1-a6d7-751611eb6a05 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05" status: 200 len: 1362 microversion: 2.1 time: 0.136331 Aug 27 04:40:06.695699 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 485/955] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:40:06 2021] GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05 => generated 1362 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:40:07.509745 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-951ea35a-b365-4157-b232-3d8476699882 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:07.510366 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-951ea35a-b365-4157-b232-3d8476699882 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:07.516639 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-951ea35a-b365-4157-b232-3d8476699882 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:07.517089 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-951ea35a-b365-4157-b232-3d8476699882 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:07.517862 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-951ea35a-b365-4157-b232-3d8476699882 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:07.518296 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-951ea35a-b365-4157-b232-3d8476699882 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:07.642742 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-951ea35a-b365-4157-b232-3d8476699882 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:07.652947 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-951ea35a-b365-4157-b232-3d8476699882 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1567 microversion: 2.1 time: 0.147397 Aug 27 04:40:07.653680 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 486/956] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:40:07 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:40:07.713576 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-412286e4-3f12-4170-99bd-c8b1390db764 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:07.714520 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-412286e4-3f12-4170-99bd-c8b1390db764 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:07.722432 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-412286e4-3f12-4170-99bd-c8b1390db764 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:07.723110 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-412286e4-3f12-4170-99bd-c8b1390db764 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:07.724335 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-412286e4-3f12-4170-99bd-c8b1390db764 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:07.724889 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-412286e4-3f12-4170-99bd-c8b1390db764 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:07.845586 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-412286e4-3f12-4170-99bd-c8b1390db764 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:07.853198 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-412286e4-3f12-4170-99bd-c8b1390db764 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05" status: 200 len: 1362 microversion: 2.1 time: 0.144803 Aug 27 04:40:07.853747 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 487/957] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:40:07 2021] GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05 => generated 1362 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:40:08.670173 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-c4a97ae5-933c-4095-8307-6c3979fc1650 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:08.670841 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-c4a97ae5-933c-4095-8307-6c3979fc1650 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:08.676733 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c4a97ae5-933c-4095-8307-6c3979fc1650 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:08.677183 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c4a97ae5-933c-4095-8307-6c3979fc1650 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:08.677944 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c4a97ae5-933c-4095-8307-6c3979fc1650 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:08.678997 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c4a97ae5-933c-4095-8307-6c3979fc1650 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:08.800769 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-c4a97ae5-933c-4095-8307-6c3979fc1650 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:08.809932 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-c4a97ae5-933c-4095-8307-6c3979fc1650 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1567 microversion: 2.1 time: 0.143272 Aug 27 04:40:08.810767 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 488/958] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:40:08 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1567 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:40:08.870643 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-36d0a651-7a23-417b-9359-b6426db84ec0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:08.871249 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-36d0a651-7a23-417b-9359-b6426db84ec0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:08.877119 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-36d0a651-7a23-417b-9359-b6426db84ec0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:08.877561 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-36d0a651-7a23-417b-9359-b6426db84ec0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:08.878321 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-36d0a651-7a23-417b-9359-b6426db84ec0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:08.878806 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-36d0a651-7a23-417b-9359-b6426db84ec0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:09.229145 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-36d0a651-7a23-417b-9359-b6426db84ec0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:09.236641 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-36d0a651-7a23-417b-9359-b6426db84ec0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05" status: 200 len: 1362 microversion: 2.1 time: 0.369739 Aug 27 04:40:09.237199 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 489/959] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:40:08 2021] GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05 => generated 1362 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:09.827416 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-ce6a1de5-b5b6-419b-9428-4d06467bcb69 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:09.828141 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-ce6a1de5-b5b6-419b-9428-4d06467bcb69 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:09.834248 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ce6a1de5-b5b6-419b-9428-4d06467bcb69 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:09.835181 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ce6a1de5-b5b6-419b-9428-4d06467bcb69 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:09.835929 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ce6a1de5-b5b6-419b-9428-4d06467bcb69 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:09.836382 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ce6a1de5-b5b6-419b-9428-4d06467bcb69 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:09.955516 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-ce6a1de5-b5b6-419b-9428-4d06467bcb69 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:09.963655 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-ce6a1de5-b5b6-419b-9428-4d06467bcb69 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1567 microversion: 2.1 time: 0.139853 Aug 27 04:40:09.964277 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 490/960] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:40:09 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1567 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:40:10.254027 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-50e0a442-d634-479d-a64b-4c1aa4966d55 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:10.254638 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-50e0a442-d634-479d-a64b-4c1aa4966d55 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:10.261077 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-50e0a442-d634-479d-a64b-4c1aa4966d55 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:10.261523 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-50e0a442-d634-479d-a64b-4c1aa4966d55 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:10.262284 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-50e0a442-d634-479d-a64b-4c1aa4966d55 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:10.262719 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-50e0a442-d634-479d-a64b-4c1aa4966d55 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:10.389475 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-50e0a442-d634-479d-a64b-4c1aa4966d55 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:10.396650 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-50e0a442-d634-479d-a64b-4c1aa4966d55 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05" status: 200 len: 1362 microversion: 2.1 time: 0.146260 Aug 27 04:40:10.397495 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 491/961] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:40:10 2021] GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:40:10.980854 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-52ebc4c3-98e5-4917-875d-7c1127a2ce27 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:10.981529 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-52ebc4c3-98e5-4917-875d-7c1127a2ce27 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:10.987551 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-52ebc4c3-98e5-4917-875d-7c1127a2ce27 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:10.988006 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-52ebc4c3-98e5-4917-875d-7c1127a2ce27 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:10.988768 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-52ebc4c3-98e5-4917-875d-7c1127a2ce27 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:10.989200 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-52ebc4c3-98e5-4917-875d-7c1127a2ce27 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:11.125697 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-52ebc4c3-98e5-4917-875d-7c1127a2ce27 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:11.133199 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-52ebc4c3-98e5-4917-875d-7c1127a2ce27 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1567 microversion: 2.1 time: 0.155928 Aug 27 04:40:11.134228 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 492/962] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:40:10 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:40:11.264131 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-eca16d1b-ddd8-4195-b755-c2426e9e8d5b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28197 microversion: 2.20 time: 5.540142 Aug 27 04:40:11.264820 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 471/963] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:40:05 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28197 bytes in 5542 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:40:11.413237 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-6a2f61a7-5add-4e3c-868a-86e8dc3e855c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:11.413839 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-6a2f61a7-5add-4e3c-868a-86e8dc3e855c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:11.419918 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6a2f61a7-5add-4e3c-868a-86e8dc3e855c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:11.420401 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6a2f61a7-5add-4e3c-868a-86e8dc3e855c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:11.421201 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6a2f61a7-5add-4e3c-868a-86e8dc3e855c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:11.421637 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6a2f61a7-5add-4e3c-868a-86e8dc3e855c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:11.541255 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-6a2f61a7-5add-4e3c-868a-86e8dc3e855c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:11.549818 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-6a2f61a7-5add-4e3c-868a-86e8dc3e855c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05" status: 200 len: 1362 microversion: 2.1 time: 0.140221 Aug 27 04:40:11.550400 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 493/964] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:40:11 2021] GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05 => generated 1362 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:12.150688 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-5ff49229-4263-4d98-95c1-4a7594293bc7 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:12.151399 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-5ff49229-4263-4d98-95c1-4a7594293bc7 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:12.157921 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5ff49229-4263-4d98-95c1-4a7594293bc7 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:12.158375 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5ff49229-4263-4d98-95c1-4a7594293bc7 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:12.159151 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5ff49229-4263-4d98-95c1-4a7594293bc7 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:12.159590 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5ff49229-4263-4d98-95c1-4a7594293bc7 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:12.276792 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-ac648223-8937-4df8-b80a-8047d325caec tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:12.278301 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-ac648223-8937-4df8-b80a-8047d325caec tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:12.300367 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ac648223-8937-4df8-b80a-8047d325caec tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:12.301220 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ac648223-8937-4df8-b80a-8047d325caec tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:12.302358 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ac648223-8937-4df8-b80a-8047d325caec tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:12.302837 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ac648223-8937-4df8-b80a-8047d325caec tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:12.304355 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-5ff49229-4263-4d98-95c1-4a7594293bc7 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:12.314603 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-5ff49229-4263-4d98-95c1-4a7594293bc7 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1567 microversion: 2.1 time: 0.167958 Aug 27 04:40:12.315785 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 472/965] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:40:12 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:40:12.474190 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-ac648223-8937-4df8-b80a-8047d325caec tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28197 microversion: 2.20 time: 0.202098 Aug 27 04:40:12.475543 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 494/966] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:40:12 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28197 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:40:12.566603 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-4f7f3f46-ca62-4745-a970-e33d02962063 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:12.567320 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-4f7f3f46-ca62-4745-a970-e33d02962063 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:12.573092 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4f7f3f46-ca62-4745-a970-e33d02962063 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:12.573540 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4f7f3f46-ca62-4745-a970-e33d02962063 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:12.574313 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4f7f3f46-ca62-4745-a970-e33d02962063 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:12.574754 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4f7f3f46-ca62-4745-a970-e33d02962063 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:12.700914 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-4f7f3f46-ca62-4745-a970-e33d02962063 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:12.708098 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-4f7f3f46-ca62-4745-a970-e33d02962063 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05" status: 200 len: 1362 microversion: 2.1 time: 0.145210 Aug 27 04:40:12.708655 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 473/967] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:40:12 2021] GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05 => generated 1362 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:40:13.331654 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-7ec181a6-5848-44a6-9c29-8c8e93498014 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:13.332382 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-7ec181a6-5848-44a6-9c29-8c8e93498014 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:13.338885 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7ec181a6-5848-44a6-9c29-8c8e93498014 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:13.339341 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7ec181a6-5848-44a6-9c29-8c8e93498014 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:13.340141 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7ec181a6-5848-44a6-9c29-8c8e93498014 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:13.340580 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7ec181a6-5848-44a6-9c29-8c8e93498014 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:13.486791 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-df25d207-038a-4324-9cb0-203ad629706d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:13.487753 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-df25d207-038a-4324-9cb0-203ad629706d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:13.489152 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-7ec181a6-5848-44a6-9c29-8c8e93498014 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:13.494351 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-df25d207-038a-4324-9cb0-203ad629706d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:13.494803 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-df25d207-038a-4324-9cb0-203ad629706d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:13.495569 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-df25d207-038a-4324-9cb0-203ad629706d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:13.496027 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-df25d207-038a-4324-9cb0-203ad629706d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:13.497005 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-7ec181a6-5848-44a6-9c29-8c8e93498014 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1508 microversion: 2.1 time: 0.169244 Aug 27 04:40:13.497606 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 495/968] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:40:13 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1508 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:13.513491 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-32979885-d3a5-4a01-b4fe-b88a432842d1 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:13.514053 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-32979885-d3a5-4a01-b4fe-b88a432842d1 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:13.519806 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-32979885-d3a5-4a01-b4fe-b88a432842d1 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:13.520217 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-32979885-d3a5-4a01-b4fe-b88a432842d1 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:13.520981 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-32979885-d3a5-4a01-b4fe-b88a432842d1 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:13.521416 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-32979885-d3a5-4a01-b4fe-b88a432842d1 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:13.594594 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-32979885-d3a5-4a01-b4fe-b88a432842d1 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "POST /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66/action" status: 202 len: 0 microversion: 2.1 time: 0.084734 Aug 27 04:40:13.595207 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 496/969] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:40:13 2021] POST /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:40:13.602929 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-efb9d5fb-c0a5-47d2-9e88-f197d0a9708d tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:13.603569 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-efb9d5fb-c0a5-47d2-9e88-f197d0a9708d tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:13.609728 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-efb9d5fb-c0a5-47d2-9e88-f197d0a9708d tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:13.610183 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-efb9d5fb-c0a5-47d2-9e88-f197d0a9708d tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:13.610978 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-efb9d5fb-c0a5-47d2-9e88-f197d0a9708d tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:13.611417 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-efb9d5fb-c0a5-47d2-9e88-f197d0a9708d tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:13.627138 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-df25d207-038a-4324-9cb0-203ad629706d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28197 microversion: 2.20 time: 0.143806 Aug 27 04:40:13.628306 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 474/970] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:40:13 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:40:13.732672 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-64d2fcc5-a733-4747-a706-7998844277e0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:13.733965 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-64d2fcc5-a733-4747-a706-7998844277e0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:13.738981 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-efb9d5fb-c0a5-47d2-9e88-f197d0a9708d tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:13.746037 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-64d2fcc5-a733-4747-a706-7998844277e0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:13.746868 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-64d2fcc5-a733-4747-a706-7998844277e0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:13.747635 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-efb9d5fb-c0a5-47d2-9e88-f197d0a9708d tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1516 microversion: 2.1 time: 0.148301 Aug 27 04:40:13.748412 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-64d2fcc5-a733-4747-a706-7998844277e0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:13.748610 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 497/971] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:40:13 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1516 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:40:13.749738 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-64d2fcc5-a733-4747-a706-7998844277e0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:13.915662 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-64d2fcc5-a733-4747-a706-7998844277e0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:13.923470 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-64d2fcc5-a733-4747-a706-7998844277e0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05" status: 200 len: 1362 microversion: 2.1 time: 0.200368 Aug 27 04:40:13.924236 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 475/972] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:40:13 2021] GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05 => generated 1362 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:40:14.638993 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-2936d629-5e8b-48b8-b686-c9fe474d08d6 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:14.639901 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-2936d629-5e8b-48b8-b686-c9fe474d08d6 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:14.646844 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-2936d629-5e8b-48b8-b686-c9fe474d08d6 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:14.647869 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-2936d629-5e8b-48b8-b686-c9fe474d08d6 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:14.648818 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-2936d629-5e8b-48b8-b686-c9fe474d08d6 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:14.649298 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-2936d629-5e8b-48b8-b686-c9fe474d08d6 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:14.741255 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-2936d629-5e8b-48b8-b686-c9fe474d08d6 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28197 microversion: 2.20 time: 0.106202 Aug 27 04:40:14.742242 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 498/973] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:40:14 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:40:14.764947 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-e8054c54-7dd2-476c-985d-081c72958985 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:14.765621 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-e8054c54-7dd2-476c-985d-081c72958985 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:14.772691 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e8054c54-7dd2-476c-985d-081c72958985 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:14.773237 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e8054c54-7dd2-476c-985d-081c72958985 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:14.774175 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e8054c54-7dd2-476c-985d-081c72958985 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:14.774676 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e8054c54-7dd2-476c-985d-081c72958985 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:14.897028 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-e8054c54-7dd2-476c-985d-081c72958985 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:14.904279 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-e8054c54-7dd2-476c-985d-081c72958985 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1518 microversion: 2.1 time: 0.142970 Aug 27 04:40:14.904857 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 476/974] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:40:14 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1518 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:14.941421 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-f26fe632-bfe4-47ff-8cd7-5d1ea8302392 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:14.942122 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-f26fe632-bfe4-47ff-8cd7-5d1ea8302392 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:14.949252 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f26fe632-bfe4-47ff-8cd7-5d1ea8302392 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:14.949708 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f26fe632-bfe4-47ff-8cd7-5d1ea8302392 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:14.950474 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f26fe632-bfe4-47ff-8cd7-5d1ea8302392 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:14.950910 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f26fe632-bfe4-47ff-8cd7-5d1ea8302392 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:15.076262 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-f26fe632-bfe4-47ff-8cd7-5d1ea8302392 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:15.083390 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-f26fe632-bfe4-47ff-8cd7-5d1ea8302392 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05" status: 200 len: 1362 microversion: 2.1 time: 0.146063 Aug 27 04:40:15.083946 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 499/975] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:40:14 2021] GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05 => generated 1362 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:15.753124 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-668ed63d-db95-4e81-86dc-42260ad669c5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:15.754240 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-668ed63d-db95-4e81-86dc-42260ad669c5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:15.760257 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-668ed63d-db95-4e81-86dc-42260ad669c5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:15.760829 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-668ed63d-db95-4e81-86dc-42260ad669c5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:15.761607 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-668ed63d-db95-4e81-86dc-42260ad669c5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:15.762052 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-668ed63d-db95-4e81-86dc-42260ad669c5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:15.868949 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-668ed63d-db95-4e81-86dc-42260ad669c5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28197 microversion: 2.20 time: 0.119395 Aug 27 04:40:15.869730 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 477/976] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:40:15 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:40:15.921964 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-597f59fc-2ebc-454e-8aa8-4783d67399fa tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:15.922771 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-597f59fc-2ebc-454e-8aa8-4783d67399fa tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:15.928874 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-597f59fc-2ebc-454e-8aa8-4783d67399fa tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:15.929318 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-597f59fc-2ebc-454e-8aa8-4783d67399fa tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:15.930158 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-597f59fc-2ebc-454e-8aa8-4783d67399fa tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:15.930591 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-597f59fc-2ebc-454e-8aa8-4783d67399fa tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:16.057889 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-597f59fc-2ebc-454e-8aa8-4783d67399fa tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:16.069294 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-597f59fc-2ebc-454e-8aa8-4783d67399fa tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1574 microversion: 2.1 time: 0.149357 Aug 27 04:40:16.070312 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 500/977] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:40:15 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:16.100737 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-202e662c-0e7f-47d0-9691-836a639cf3a5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:16.101471 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-202e662c-0e7f-47d0-9691-836a639cf3a5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:16.108465 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-202e662c-0e7f-47d0-9691-836a639cf3a5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:16.108924 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-202e662c-0e7f-47d0-9691-836a639cf3a5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:16.109699 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-202e662c-0e7f-47d0-9691-836a639cf3a5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:16.110138 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-202e662c-0e7f-47d0-9691-836a639cf3a5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:16.256810 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [req-260fd45c-02e8-4a25-a073-4e80bb44186f req-5d39303d-8016-4a91-8264-15626d1e95b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2051c4e-353b-4875-8217-513125bcaf66", "name": "network-vif-unplugged", "status": "completed", "tag": "236b6127-484d-477e-b8eb-9cc2f556a39e"}]} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:16.258842 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:40:16.258842 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: warnings.warn(msg) Aug 27 04:40:16.267325 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-260fd45c-02e8-4a25-a073-4e80bb44186f req-5d39303d-8016-4a91-8264-15626d1e95b7 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:16.267696 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-260fd45c-02e8-4a25-a073-4e80bb44186f req-5d39303d-8016-4a91-8264-15626d1e95b7 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:16.282366 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.compute.server_external_events [req-260fd45c-02e8-4a25-a073-4e80bb44186f req-5d39303d-8016-4a91-8264-15626d1e95b7 service nova] Creating event network-vif-unplugged:236b6127-484d-477e-b8eb-9cc2f556a39e for instance e2051c4e-353b-4875-8217-513125bcaf66 on hv-cinder-80403 Aug 27 04:40:16.287253 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [req-260fd45c-02e8-4a25-a073-4e80bb44186f req-5d39303d-8016-4a91-8264-15626d1e95b7 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034518 Aug 27 04:40:16.288119 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 501/978] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:40:16 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:40:16.313416 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-202e662c-0e7f-47d0-9691-836a639cf3a5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:16.321667 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-202e662c-0e7f-47d0-9691-836a639cf3a5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05" status: 200 len: 1362 microversion: 2.1 time: 0.225017 Aug 27 04:40:16.322352 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 478/979] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:40:16 2021] GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05 => generated 1362 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:16.881045 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-3edb2a80-d31c-45b3-8bcd-f082af144bf5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:16.882165 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-3edb2a80-d31c-45b3-8bcd-f082af144bf5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:16.888215 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3edb2a80-d31c-45b3-8bcd-f082af144bf5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:16.888657 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3edb2a80-d31c-45b3-8bcd-f082af144bf5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:16.889413 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3edb2a80-d31c-45b3-8bcd-f082af144bf5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:16.889839 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3edb2a80-d31c-45b3-8bcd-f082af144bf5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:17.063626 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-3edb2a80-d31c-45b3-8bcd-f082af144bf5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28197 microversion: 2.20 time: 0.186435 Aug 27 04:40:17.064321 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 502/980] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:40:16 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28197 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:40:17.086989 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-d237b667-13d9-4ee3-9c37-48388e5e1b80 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:17.087722 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-d237b667-13d9-4ee3-9c37-48388e5e1b80 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:17.093741 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d237b667-13d9-4ee3-9c37-48388e5e1b80 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:17.094190 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d237b667-13d9-4ee3-9c37-48388e5e1b80 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:17.095077 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d237b667-13d9-4ee3-9c37-48388e5e1b80 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:17.095514 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d237b667-13d9-4ee3-9c37-48388e5e1b80 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:17.219825 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-d237b667-13d9-4ee3-9c37-48388e5e1b80 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:17.227615 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-d237b667-13d9-4ee3-9c37-48388e5e1b80 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1574 microversion: 2.1 time: 0.144756 Aug 27 04:40:17.227911 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 479/981] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:40:17 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1574 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:40:17.339554 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-522fafdf-cf6c-400d-bcc6-edb3001aaabe tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:17.340190 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-522fafdf-cf6c-400d-bcc6-edb3001aaabe tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:17.346662 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-522fafdf-cf6c-400d-bcc6-edb3001aaabe tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:17.347088 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-522fafdf-cf6c-400d-bcc6-edb3001aaabe tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:17.347918 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-522fafdf-cf6c-400d-bcc6-edb3001aaabe tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:17.348465 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-522fafdf-cf6c-400d-bcc6-edb3001aaabe tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:17.475439 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-522fafdf-cf6c-400d-bcc6-edb3001aaabe tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:17.482817 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-522fafdf-cf6c-400d-bcc6-edb3001aaabe tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05" status: 200 len: 1362 microversion: 2.1 time: 0.147793 Aug 27 04:40:17.483371 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 503/982] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:40:17 2021] GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:18.075005 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-79e098da-c7c3-41ef-a063-a4ddeec14961 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:18.075926 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-79e098da-c7c3-41ef-a063-a4ddeec14961 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:18.081787 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-79e098da-c7c3-41ef-a063-a4ddeec14961 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:18.082236 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-79e098da-c7c3-41ef-a063-a4ddeec14961 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:18.083003 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-79e098da-c7c3-41ef-a063-a4ddeec14961 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:18.083441 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-79e098da-c7c3-41ef-a063-a4ddeec14961 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:18.241192 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-79e098da-c7c3-41ef-a063-a4ddeec14961 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28197 microversion: 2.20 time: 0.169581 Aug 27 04:40:18.241979 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 480/983] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:40:18 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28197 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:40:18.247925 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-528aea60-6aef-4333-8d56-e01353a07f76 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:18.248926 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-528aea60-6aef-4333-8d56-e01353a07f76 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:18.255147 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-528aea60-6aef-4333-8d56-e01353a07f76 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:18.255597 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-528aea60-6aef-4333-8d56-e01353a07f76 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:18.256427 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-528aea60-6aef-4333-8d56-e01353a07f76 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:18.256863 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-528aea60-6aef-4333-8d56-e01353a07f76 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:18.390857 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-528aea60-6aef-4333-8d56-e01353a07f76 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:18.398725 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-528aea60-6aef-4333-8d56-e01353a07f76 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1574 microversion: 2.1 time: 0.157869 Aug 27 04:40:18.399282 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 504/984] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:40:18 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:40:18.501133 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-3dca8c3e-c22d-4efb-805c-936ccddadb15 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:18.501821 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-3dca8c3e-c22d-4efb-805c-936ccddadb15 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:18.508361 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3dca8c3e-c22d-4efb-805c-936ccddadb15 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:18.508803 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3dca8c3e-c22d-4efb-805c-936ccddadb15 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:18.509560 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3dca8c3e-c22d-4efb-805c-936ccddadb15 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:18.509993 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3dca8c3e-c22d-4efb-805c-936ccddadb15 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:18.635624 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-3dca8c3e-c22d-4efb-805c-936ccddadb15 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:18.642894 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-3dca8c3e-c22d-4efb-805c-936ccddadb15 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05" status: 200 len: 1362 microversion: 2.1 time: 0.145798 Aug 27 04:40:18.643444 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 481/985] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:40:18 2021] GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05 => generated 1362 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:19.255078 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-d7826f81-2f1e-4649-b8c9-158ffd528bca tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:19.256978 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-d7826f81-2f1e-4649-b8c9-158ffd528bca tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:19.263309 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d7826f81-2f1e-4649-b8c9-158ffd528bca tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:19.263769 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d7826f81-2f1e-4649-b8c9-158ffd528bca tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:19.264574 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d7826f81-2f1e-4649-b8c9-158ffd528bca tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:19.265035 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d7826f81-2f1e-4649-b8c9-158ffd528bca tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:19.368888 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-d7826f81-2f1e-4649-b8c9-158ffd528bca tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28197 microversion: 2.20 time: 0.117251 Aug 27 04:40:19.369669 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-073efc1f-b304-4b60-bbb4-c426553135fb tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1797615336"}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:19.370048 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 505/986] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:40:19 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:40:19.370141 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-073efc1f-b304-4b60-bbb4-c426553135fb tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [instance: 89e425c1-0168-4f5d-8635-dd6b9f88c580] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:19.375752 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-073efc1f-b304-4b60-bbb4-c426553135fb tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:19.376328 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-073efc1f-b304-4b60-bbb4-c426553135fb tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:19.377145 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-073efc1f-b304-4b60-bbb4-c426553135fb tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:19.377587 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-073efc1f-b304-4b60-bbb4-c426553135fb tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:19.416662 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-960df489-00c9-450a-8274-c80ba3cd6f71 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:19.417426 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-960df489-00c9-450a-8274-c80ba3cd6f71 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:19.424735 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-960df489-00c9-450a-8274-c80ba3cd6f71 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:19.425181 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-960df489-00c9-450a-8274-c80ba3cd6f71 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:19.425955 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-960df489-00c9-450a-8274-c80ba3cd6f71 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:19.426393 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-960df489-00c9-450a-8274-c80ba3cd6f71 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:19.518622 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.network.security_group_api [None req-073efc1f-b304-4b60-bbb4-c426553135fb tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Removing security group 14b7e024-8502-417f-9c85-de1b593e5325 from port 6348fecd-7464-4987-a099-9e9f7e860b0c Aug 27 04:40:19.563944 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-960df489-00c9-450a-8274-c80ba3cd6f71 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:19.572558 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-960df489-00c9-450a-8274-c80ba3cd6f71 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1574 microversion: 2.1 time: 0.160092 Aug 27 04:40:19.573219 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 506/987] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:40:19 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:40:19.659843 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-43e7dc28-546f-4cdc-9655-89caf9746adc tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:19.660577 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-43e7dc28-546f-4cdc-9655-89caf9746adc tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:19.667076 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-43e7dc28-546f-4cdc-9655-89caf9746adc tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:19.667526 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-43e7dc28-546f-4cdc-9655-89caf9746adc tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:19.668307 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-43e7dc28-546f-4cdc-9655-89caf9746adc tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:19.668732 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-43e7dc28-546f-4cdc-9655-89caf9746adc tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:19.802874 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-43e7dc28-546f-4cdc-9655-89caf9746adc tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:19.810825 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-43e7dc28-546f-4cdc-9655-89caf9746adc tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05" status: 200 len: 1362 microversion: 2.1 time: 0.154565 Aug 27 04:40:19.811402 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 507/988] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:40:19 2021] GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:40:19.868235 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-073efc1f-b304-4b60-bbb4-c426553135fb tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "POST /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580/action" status: 202 len: 0 microversion: 2.1 time: 0.603803 Aug 27 04:40:19.869390 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 482/989] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:40:19 2021] POST /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580/action => generated 0 bytes in 607 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:40:19.875079 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [req-6908441e-fc0b-420d-826b-766280fa2343 req-40733bcd-e86a-49a9-87d1-859204da1fd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89e425c1-0168-4f5d-8635-dd6b9f88c580", "tag": "6348fecd-7464-4987-a099-9e9f7e860b0c"}]} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:19.877221 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:40:19.877221 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: warnings.warn(msg) Aug 27 04:40:19.884239 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-6908441e-fc0b-420d-826b-766280fa2343 req-40733bcd-e86a-49a9-87d1-859204da1fd9 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:19.884928 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-6908441e-fc0b-420d-826b-766280fa2343 req-40733bcd-e86a-49a9-87d1-859204da1fd9 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:19.908953 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.compute.server_external_events [req-6908441e-fc0b-420d-826b-766280fa2343 req-40733bcd-e86a-49a9-87d1-859204da1fd9 service nova] Creating event network-changed:6348fecd-7464-4987-a099-9e9f7e860b0c for instance 89e425c1-0168-4f5d-8635-dd6b9f88c580 on hv-cinder-80403 Aug 27 04:40:19.928517 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [req-6908441e-fc0b-420d-826b-766280fa2343 req-40733bcd-e86a-49a9-87d1-859204da1fd9 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056236 Aug 27 04:40:19.931744 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 508/990] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:40:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:40:20.381972 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-af688a19-f974-4b10-b9c8-a196c3afc996 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:20.383485 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-af688a19-f974-4b10-b9c8-a196c3afc996 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:20.390699 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-af688a19-f974-4b10-b9c8-a196c3afc996 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:20.391680 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-af688a19-f974-4b10-b9c8-a196c3afc996 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:20.392809 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-af688a19-f974-4b10-b9c8-a196c3afc996 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:20.393255 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-af688a19-f974-4b10-b9c8-a196c3afc996 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:20.460186 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [req-f1978612-f55b-45ed-b826-bd673bf68b2d req-f16e2092-cec5-4024-ad5b-26e09aadb463 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d90eb911-b246-4928-ac32-cb9eb412ac05", "name": "network-vif-plugged", "status": "completed", "tag": "be02021d-efc7-490f-b112-ba663b0a0f36"}]} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:20.462637 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:40:20.462637 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: warnings.warn(msg) Aug 27 04:40:20.474660 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-f1978612-f55b-45ed-b826-bd673bf68b2d req-f16e2092-cec5-4024-ad5b-26e09aadb463 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:20.475447 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-f1978612-f55b-45ed-b826-bd673bf68b2d req-f16e2092-cec5-4024-ad5b-26e09aadb463 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:20.489836 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.compute.server_external_events [req-f1978612-f55b-45ed-b826-bd673bf68b2d req-f16e2092-cec5-4024-ad5b-26e09aadb463 service nova] Creating event network-vif-plugged:be02021d-efc7-490f-b112-ba663b0a0f36 for instance d90eb911-b246-4928-ac32-cb9eb412ac05 on hv-cinder-80403 Aug 27 04:40:20.495783 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [req-f1978612-f55b-45ed-b826-bd673bf68b2d req-f16e2092-cec5-4024-ad5b-26e09aadb463 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040763 Aug 27 04:40:20.497658 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 509/991] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:40:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:40:20.597650 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-9881a875-fc14-42f2-a0d2-39da1110027a tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:20.598362 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-9881a875-fc14-42f2-a0d2-39da1110027a tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:20.605564 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9881a875-fc14-42f2-a0d2-39da1110027a tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:20.606008 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9881a875-fc14-42f2-a0d2-39da1110027a tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:20.607054 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9881a875-fc14-42f2-a0d2-39da1110027a tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:20.607495 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9881a875-fc14-42f2-a0d2-39da1110027a tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:20.728168 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-af688a19-f974-4b10-b9c8-a196c3afc996 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28487 microversion: 2.20 time: 0.350105 Aug 27 04:40:20.729338 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 483/992] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:40:20 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28487 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:40:20.833811 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-2bb3f453-3e78-4cac-80db-57b52c701e81 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:20.835259 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-2bb3f453-3e78-4cac-80db-57b52c701e81 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:20.846961 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2bb3f453-3e78-4cac-80db-57b52c701e81 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:20.847776 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2bb3f453-3e78-4cac-80db-57b52c701e81 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:20.849404 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2bb3f453-3e78-4cac-80db-57b52c701e81 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:20.850235 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2bb3f453-3e78-4cac-80db-57b52c701e81 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:20.936168 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-9881a875-fc14-42f2-a0d2-39da1110027a tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:20.948431 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-9881a875-fc14-42f2-a0d2-39da1110027a tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1574 microversion: 2.1 time: 0.354842 Aug 27 04:40:20.958258 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 510/993] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:40:20 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1574 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:40:21.005517 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-2bb3f453-3e78-4cac-80db-57b52c701e81 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:21.013877 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-2bb3f453-3e78-4cac-80db-57b52c701e81 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05" status: 200 len: 1362 microversion: 2.1 time: 0.188560 Aug 27 04:40:21.014447 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 484/994] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:40:20 2021] GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05 => generated 1362 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:21.206174 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-9d9133e3-dea5-4aed-b072-74f227410538 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:21.207064 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-9d9133e3-dea5-4aed-b072-74f227410538 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [instance: 89e425c1-0168-4f5d-8635-dd6b9f88c580] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:21.214309 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9d9133e3-dea5-4aed-b072-74f227410538 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:21.214512 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [req-41d4f9e7-4eef-4e05-b4ab-d679987dab72 req-e99c9cfa-97aa-47b1-b648-5e8dd597b23c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89e425c1-0168-4f5d-8635-dd6b9f88c580", "tag": "6348fecd-7464-4987-a099-9e9f7e860b0c"}]} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:21.214759 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9d9133e3-dea5-4aed-b072-74f227410538 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:21.215529 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9d9133e3-dea5-4aed-b072-74f227410538 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:21.216019 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9d9133e3-dea5-4aed-b072-74f227410538 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:21.216267 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:40:21.216267 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: warnings.warn(msg) Aug 27 04:40:21.223428 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-41d4f9e7-4eef-4e05-b4ab-d679987dab72 req-e99c9cfa-97aa-47b1-b648-5e8dd597b23c service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:21.223889 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-41d4f9e7-4eef-4e05-b4ab-d679987dab72 req-e99c9cfa-97aa-47b1-b648-5e8dd597b23c service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:21.236408 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.compute.server_external_events [req-41d4f9e7-4eef-4e05-b4ab-d679987dab72 req-e99c9cfa-97aa-47b1-b648-5e8dd597b23c service nova] Creating event network-changed:6348fecd-7464-4987-a099-9e9f7e860b0c for instance 89e425c1-0168-4f5d-8635-dd6b9f88c580 on hv-cinder-80403 Aug 27 04:40:21.242124 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [req-41d4f9e7-4eef-4e05-b4ab-d679987dab72 req-e99c9cfa-97aa-47b1-b648-5e8dd597b23c service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031100 Aug 27 04:40:21.242722 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 485/995] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:40:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:40:21.303763 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.objects.instance [None req-9d9133e3-dea5-4aed-b072-74f227410538 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lazy-loading 'services' on Instance uuid 89e425c1-0168-4f5d-8635-dd6b9f88c580 {{(pid=108971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:40:21.382705 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-9d9133e3-dea5-4aed-b072-74f227410538 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "DELETE /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580/os-volume_attachments/5e03692b-d9f6-4291-82a2-9a57cfc1cb67" status: 202 len: 0 microversion: 2.1 time: 0.179592 Aug 27 04:40:21.399372 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 511/996] 10.222.0.53 () {58 vars in 1416 bytes} [Fri Aug 27 04:40:21 2021] DELETE /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580/os-volume_attachments/5e03692b-d9f6-4291-82a2-9a57cfc1cb67 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:40:21.399698 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-dc0db22e-e928-4bcd-b0d7-948781df160c tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:21.401748 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-dc0db22e-e928-4bcd-b0d7-948781df160c tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [instance: 89e425c1-0168-4f5d-8635-dd6b9f88c580] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:21.408175 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-dc0db22e-e928-4bcd-b0d7-948781df160c tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:21.408628 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-dc0db22e-e928-4bcd-b0d7-948781df160c tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:21.409458 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-dc0db22e-e928-4bcd-b0d7-948781df160c tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:21.410048 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-dc0db22e-e928-4bcd-b0d7-948781df160c tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:21.450265 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-dc0db22e-e928-4bcd-b0d7-948781df160c tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059006 Aug 27 04:40:21.450834 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 486/997] 10.222.0.53 () {58 vars in 1302 bytes} [Fri Aug 27 04:40:21 2021] GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:40:21.750700 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-22d6f4f9-6928-4a07-aedf-0d4159f57c66 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:21.756367 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-22d6f4f9-6928-4a07-aedf-0d4159f57c66 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:21.783769 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-22d6f4f9-6928-4a07-aedf-0d4159f57c66 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:21.784812 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-22d6f4f9-6928-4a07-aedf-0d4159f57c66 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:21.785869 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-22d6f4f9-6928-4a07-aedf-0d4159f57c66 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:21.786539 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-22d6f4f9-6928-4a07-aedf-0d4159f57c66 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:21.887898 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-22d6f4f9-6928-4a07-aedf-0d4159f57c66 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28487 microversion: 2.20 time: 0.149081 Aug 27 04:40:21.892063 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 512/998] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:40:21 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28487 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:40:21.966165 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-9be10ab8-6a1f-4cb2-b4b9-22c08032f2a1 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:21.966781 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-9be10ab8-6a1f-4cb2-b4b9-22c08032f2a1 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:21.975561 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9be10ab8-6a1f-4cb2-b4b9-22c08032f2a1 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:21.976041 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9be10ab8-6a1f-4cb2-b4b9-22c08032f2a1 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:21.976946 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9be10ab8-6a1f-4cb2-b4b9-22c08032f2a1 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:21.977447 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9be10ab8-6a1f-4cb2-b4b9-22c08032f2a1 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:22.031064 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-7ae2ea9f-fa9c-4475-a632-c0880861398d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:22.032637 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-7ae2ea9f-fa9c-4475-a632-c0880861398d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:22.042300 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7ae2ea9f-fa9c-4475-a632-c0880861398d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:22.043131 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7ae2ea9f-fa9c-4475-a632-c0880861398d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:22.044190 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7ae2ea9f-fa9c-4475-a632-c0880861398d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:22.044869 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7ae2ea9f-fa9c-4475-a632-c0880861398d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:22.176240 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-9be10ab8-6a1f-4cb2-b4b9-22c08032f2a1 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:22.183610 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-9be10ab8-6a1f-4cb2-b4b9-22c08032f2a1 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1574 microversion: 2.1 time: 0.221220 Aug 27 04:40:22.184757 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 487/999] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:40:21 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1574 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:22.273567 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-7ae2ea9f-fa9c-4475-a632-c0880861398d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:22.284779 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-7ae2ea9f-fa9c-4475-a632-c0880861398d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05" status: 200 len: 1362 microversion: 2.1 time: 0.257640 Aug 27 04:40:22.294499 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 513/1000] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:40:22 2021] GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05 => generated 1362 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:40:22.463504 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-38dd1815-7cf7-484f-9223-b81b4ccb4266 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:22.465281 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-38dd1815-7cf7-484f-9223-b81b4ccb4266 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [instance: 89e425c1-0168-4f5d-8635-dd6b9f88c580] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:22.471490 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-38dd1815-7cf7-484f-9223-b81b4ccb4266 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:22.472533 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-38dd1815-7cf7-484f-9223-b81b4ccb4266 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:22.474188 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-38dd1815-7cf7-484f-9223-b81b4ccb4266 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:22.475542 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-38dd1815-7cf7-484f-9223-b81b4ccb4266 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:22.533419 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-38dd1815-7cf7-484f-9223-b81b4ccb4266 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074121 Aug 27 04:40:22.536054 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 488/1001] 10.222.0.53 () {58 vars in 1302 bytes} [Fri Aug 27 04:40:22 2021] GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:40:22.901689 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-d827ecfb-d301-4110-b434-49593e9bf0d9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:22.902659 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-d827ecfb-d301-4110-b434-49593e9bf0d9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:22.908891 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d827ecfb-d301-4110-b434-49593e9bf0d9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:22.909342 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d827ecfb-d301-4110-b434-49593e9bf0d9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:22.910105 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d827ecfb-d301-4110-b434-49593e9bf0d9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:22.910544 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d827ecfb-d301-4110-b434-49593e9bf0d9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:23.044107 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-d827ecfb-d301-4110-b434-49593e9bf0d9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28549 microversion: 2.20 time: 0.147530 Aug 27 04:40:23.044754 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 514/1002] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:40:22 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28549 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:40:23.204626 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-ac6fbac0-0e95-4801-8862-5f04c67bfa6e tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:23.205519 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-ac6fbac0-0e95-4801-8862-5f04c67bfa6e tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:23.215201 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ac6fbac0-0e95-4801-8862-5f04c67bfa6e tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:23.216016 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ac6fbac0-0e95-4801-8862-5f04c67bfa6e tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:23.217357 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ac6fbac0-0e95-4801-8862-5f04c67bfa6e tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:23.218135 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ac6fbac0-0e95-4801-8862-5f04c67bfa6e tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:23.303348 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-3b78023f-bbd3-4503-8395-5b690557c3f0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:23.304178 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-3b78023f-bbd3-4503-8395-5b690557c3f0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:23.310847 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3b78023f-bbd3-4503-8395-5b690557c3f0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:23.311295 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3b78023f-bbd3-4503-8395-5b690557c3f0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:23.312165 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3b78023f-bbd3-4503-8395-5b690557c3f0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:23.312673 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3b78023f-bbd3-4503-8395-5b690557c3f0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:23.367947 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-ac6fbac0-0e95-4801-8862-5f04c67bfa6e tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:23.381930 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-ac6fbac0-0e95-4801-8862-5f04c67bfa6e tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1574 microversion: 2.1 time: 0.183221 Aug 27 04:40:23.383317 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 489/1003] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:40:23 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1574 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:23.450802 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-3b78023f-bbd3-4503-8395-5b690557c3f0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:23.458236 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-3b78023f-bbd3-4503-8395-5b690557c3f0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05" status: 200 len: 1548 microversion: 2.1 time: 0.159706 Aug 27 04:40:23.458726 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 515/1004] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:40:23 2021] GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05 => generated 1548 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:40:23.478277 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-ecbe6d80-345a-4531-892d-e47f3309d468 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:23.479096 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-ecbe6d80-345a-4531-892d-e47f3309d468 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:23.488402 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ecbe6d80-345a-4531-892d-e47f3309d468 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:23.489120 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ecbe6d80-345a-4531-892d-e47f3309d468 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:23.491078 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ecbe6d80-345a-4531-892d-e47f3309d468 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:23.491866 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ecbe6d80-345a-4531-892d-e47f3309d468 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:23.558125 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-11403357-49a1-421f-b99f-862733f1cd90 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:23.559590 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-11403357-49a1-421f-b99f-862733f1cd90 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [instance: 89e425c1-0168-4f5d-8635-dd6b9f88c580] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:23.569034 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-11403357-49a1-421f-b99f-862733f1cd90 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:23.569886 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-11403357-49a1-421f-b99f-862733f1cd90 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:23.571240 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-11403357-49a1-421f-b99f-862733f1cd90 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:23.572040 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-11403357-49a1-421f-b99f-862733f1cd90 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:23.583895 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-ecbe6d80-345a-4531-892d-e47f3309d468 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.112690 Aug 27 04:40:23.584541 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 490/1005] 10.222.0.53 () {58 vars in 1275 bytes} [Fri Aug 27 04:40:23 2021] GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/os-interface => generated 284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:40:23.612891 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-11403357-49a1-421f-b99f-862733f1cd90 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.069733 Aug 27 04:40:23.613552 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 516/1006] 10.222.0.53 () {58 vars in 1302 bytes} [Fri Aug 27 04:40:23 2021] GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:40:23.623528 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-285c85ca-073f-4452-b977-6aa2839d0dbe tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:23.624029 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-285c85ca-073f-4452-b977-6aa2839d0dbe tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [instance: 89e425c1-0168-4f5d-8635-dd6b9f88c580] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:23.629857 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-285c85ca-073f-4452-b977-6aa2839d0dbe tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:23.630301 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-285c85ca-073f-4452-b977-6aa2839d0dbe tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:23.631232 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-285c85ca-073f-4452-b977-6aa2839d0dbe tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:23.631664 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-285c85ca-073f-4452-b977-6aa2839d0dbe tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:23.710923 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.wsgi [None req-285c85ca-073f-4452-b977-6aa2839d0dbe tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] HTTP exception thrown: Instance 89e425c1-0168-4f5d-8635-dd6b9f88c580 is not attached to volume 5e03692b-d9f6-4291-82a2-9a57cfc1cb67 Aug 27 04:40:23.711441 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-285c85ca-073f-4452-b977-6aa2839d0dbe tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Returning 404 to user: Instance 89e425c1-0168-4f5d-8635-dd6b9f88c580 is not attached to volume 5e03692b-d9f6-4291-82a2-9a57cfc1cb67 {{(pid=108970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:40:23.712303 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-285c85ca-073f-4452-b977-6aa2839d0dbe tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "DELETE /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580/os-volume_attachments/5e03692b-d9f6-4291-82a2-9a57cfc1cb67" status: 404 len: 154 microversion: 2.1 time: 0.092567 Aug 27 04:40:23.712851 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 491/1007] 10.222.0.53 () {58 vars in 1416 bytes} [Fri Aug 27 04:40:23 2021] DELETE /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580/os-volume_attachments/5e03692b-d9f6-4291-82a2-9a57cfc1cb67 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:40:24.056191 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-8781b069-9191-49c9-893b-e9495f8b4292 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:24.057083 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-8781b069-9191-49c9-893b-e9495f8b4292 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:24.062922 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8781b069-9191-49c9-893b-e9495f8b4292 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:24.063359 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8781b069-9191-49c9-893b-e9495f8b4292 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:24.064143 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8781b069-9191-49c9-893b-e9495f8b4292 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:24.064573 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8781b069-9191-49c9-893b-e9495f8b4292 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:24.173150 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-8781b069-9191-49c9-893b-e9495f8b4292 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28655 microversion: 2.20 time: 0.120357 Aug 27 04:40:24.174562 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 517/1008] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:40:24 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28655 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:40:24.399761 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-455fd7d7-85eb-4b6d-8ca0-f4054472ea05 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:24.400383 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-455fd7d7-85eb-4b6d-8ca0-f4054472ea05 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:24.406569 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-455fd7d7-85eb-4b6d-8ca0-f4054472ea05 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:24.407013 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-455fd7d7-85eb-4b6d-8ca0-f4054472ea05 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:24.407772 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-455fd7d7-85eb-4b6d-8ca0-f4054472ea05 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:24.408238 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-455fd7d7-85eb-4b6d-8ca0-f4054472ea05 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:24.539415 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-455fd7d7-85eb-4b6d-8ca0-f4054472ea05 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:24.547323 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-455fd7d7-85eb-4b6d-8ca0-f4054472ea05 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1574 microversion: 2.1 time: 0.151163 Aug 27 04:40:24.547907 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 492/1009] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:40:24 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:24.827492 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-f16451c0-14dd-41fb-af2a-5076a6d1614e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:24.828533 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-f16451c0-14dd-41fb-af2a-5076a6d1614e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:24.829309 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [req-15b2f306-1fbe-4604-aa04-1d5ff85a675e req-991a283a-bd61-4184-87df-fbf45278f355 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d90eb911-b246-4928-ac32-cb9eb412ac05", "tag": "be02021d-efc7-490f-b112-ba663b0a0f36"}]} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:24.831056 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:40:24.831056 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: warnings.warn(msg) Aug 27 04:40:24.836100 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f16451c0-14dd-41fb-af2a-5076a6d1614e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:24.837283 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f16451c0-14dd-41fb-af2a-5076a6d1614e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:24.838309 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f16451c0-14dd-41fb-af2a-5076a6d1614e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:24.839102 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f16451c0-14dd-41fb-af2a-5076a6d1614e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:24.840161 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-15b2f306-1fbe-4604-aa04-1d5ff85a675e req-991a283a-bd61-4184-87df-fbf45278f355 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:24.840608 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-15b2f306-1fbe-4604-aa04-1d5ff85a675e req-991a283a-bd61-4184-87df-fbf45278f355 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:24.852370 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.compute.server_external_events [req-15b2f306-1fbe-4604-aa04-1d5ff85a675e req-991a283a-bd61-4184-87df-fbf45278f355 service nova] Creating event network-changed:be02021d-efc7-490f-b112-ba663b0a0f36 for instance d90eb911-b246-4928-ac32-cb9eb412ac05 on hv-cinder-80403 Aug 27 04:40:24.857747 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [req-15b2f306-1fbe-4604-aa04-1d5ff85a675e req-991a283a-bd61-4184-87df-fbf45278f355 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031847 Aug 27 04:40:24.858347 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 493/1010] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:40:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:40:24.866151 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-733b756b-145d-4977-a788-034b28082cab tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:24.866734 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-733b756b-145d-4977-a788-034b28082cab tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [instance: 89e425c1-0168-4f5d-8635-dd6b9f88c580] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:24.873065 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-733b756b-145d-4977-a788-034b28082cab tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:24.873507 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-733b756b-145d-4977-a788-034b28082cab tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:24.874284 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-733b756b-145d-4977-a788-034b28082cab tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:24.874717 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-733b756b-145d-4977-a788-034b28082cab tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:24.906414 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-733b756b-145d-4977-a788-034b28082cab tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [instance: 89e425c1-0168-4f5d-8635-dd6b9f88c580] Going to try to terminate instance {{(pid=108970) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 04:40:24.971595 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-f16451c0-14dd-41fb-af2a-5076a6d1614e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 14 microversion: 2.1 time: 0.147741 Aug 27 04:40:24.972889 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 518/1011] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:40:24 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 14 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:40:25.042564 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-733b756b-145d-4977-a788-034b28082cab tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "DELETE /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580" status: 204 len: 0 microversion: 2.1 time: 0.179866 Aug 27 04:40:25.043794 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 494/1012] 10.222.0.53 () {58 vars in 1239 bytes} [Fri Aug 27 04:40:24 2021] DELETE /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:40:25.052107 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-b5c2c186-2a0d-4ec2-a87b-b345dd728b6a tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:25.052835 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-b5c2c186-2a0d-4ec2-a87b-b345dd728b6a tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [instance: 89e425c1-0168-4f5d-8635-dd6b9f88c580] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:25.059284 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b5c2c186-2a0d-4ec2-a87b-b345dd728b6a tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:25.060260 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b5c2c186-2a0d-4ec2-a87b-b345dd728b6a tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:25.060502 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b5c2c186-2a0d-4ec2-a87b-b345dd728b6a tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:25.061120 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b5c2c186-2a0d-4ec2-a87b-b345dd728b6a tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:25.189328 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-fa3f5bfa-c9ed-4fbb-844f-972f21552162 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:25.190341 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-fa3f5bfa-c9ed-4fbb-844f-972f21552162 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:25.191947 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-b5c2c186-2a0d-4ec2-a87b-b345dd728b6a tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b01f24964a490da63d33097d0f9a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d957eb500948908f38f0f427a9017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:25.196800 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fa3f5bfa-c9ed-4fbb-844f-972f21552162 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:25.197666 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fa3f5bfa-c9ed-4fbb-844f-972f21552162 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:25.198648 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fa3f5bfa-c9ed-4fbb-844f-972f21552162 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:25.199095 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fa3f5bfa-c9ed-4fbb-844f-972f21552162 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:25.200756 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-b5c2c186-2a0d-4ec2-a87b-b345dd728b6a tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580" status: 200 len: 1554 microversion: 2.1 time: 0.152627 Aug 27 04:40:25.207449 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 519/1013] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:40:25 2021] GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:25.566040 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-9cce39b3-c7fe-4351-87be-8b41273d9a79 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:25.566561 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-9cce39b3-c7fe-4351-87be-8b41273d9a79 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:25.573523 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9cce39b3-c7fe-4351-87be-8b41273d9a79 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:25.573964 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9cce39b3-c7fe-4351-87be-8b41273d9a79 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:25.574728 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9cce39b3-c7fe-4351-87be-8b41273d9a79 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:25.575156 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9cce39b3-c7fe-4351-87be-8b41273d9a79 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:25.713822 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-fa3f5bfa-c9ed-4fbb-844f-972f21552162 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28655 microversion: 2.20 time: 0.528591 Aug 27 04:40:25.715200 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 495/1014] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:40:25 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28655 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:40:25.781811 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-9cce39b3-c7fe-4351-87be-8b41273d9a79 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:25.789580 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-9cce39b3-c7fe-4351-87be-8b41273d9a79 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1574 microversion: 2.1 time: 0.228832 Aug 27 04:40:25.790153 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 520/1015] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:40:25 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1574 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:40:25.989993 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-bd394210-514b-4d62-910f-5a125ac0d629 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:25.992224 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-bd394210-514b-4d62-910f-5a125ac0d629 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:26.001198 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-bd394210-514b-4d62-910f-5a125ac0d629 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:26.002059 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-bd394210-514b-4d62-910f-5a125ac0d629 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:26.003094 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-bd394210-514b-4d62-910f-5a125ac0d629 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:26.003669 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-bd394210-514b-4d62-910f-5a125ac0d629 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:26.200417 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-bd394210-514b-4d62-910f-5a125ac0d629 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 14 microversion: 2.1 time: 0.218554 Aug 27 04:40:26.201154 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 496/1016] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:40:25 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 14 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:40:26.218638 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-0bc7deca-2251-4bc5-af0c-bd954a5c8c58 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:26.219353 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-0bc7deca-2251-4bc5-af0c-bd954a5c8c58 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [instance: 89e425c1-0168-4f5d-8635-dd6b9f88c580] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:26.226747 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0bc7deca-2251-4bc5-af0c-bd954a5c8c58 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:26.227200 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0bc7deca-2251-4bc5-af0c-bd954a5c8c58 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:26.228011 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0bc7deca-2251-4bc5-af0c-bd954a5c8c58 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:26.228451 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0bc7deca-2251-4bc5-af0c-bd954a5c8c58 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:26.373053 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-0bc7deca-2251-4bc5-af0c-bd954a5c8c58 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b01f24964a490da63d33097d0f9a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d957eb500948908f38f0f427a9017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:26.380457 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-0bc7deca-2251-4bc5-af0c-bd954a5c8c58 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580" status: 200 len: 1554 microversion: 2.1 time: 0.165627 Aug 27 04:40:26.381547 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 521/1017] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:40:26 2021] GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580 => generated 1554 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:26.727231 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-22a1709a-78e6-4c61-a3eb-7ebb23933b8c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:26.728455 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-22a1709a-78e6-4c61-a3eb-7ebb23933b8c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:26.735012 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-22a1709a-78e6-4c61-a3eb-7ebb23933b8c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:26.736281 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-22a1709a-78e6-4c61-a3eb-7ebb23933b8c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:26.736281 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-22a1709a-78e6-4c61-a3eb-7ebb23933b8c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:26.736766 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-22a1709a-78e6-4c61-a3eb-7ebb23933b8c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:26.806529 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-aebaff48-8ffe-4097-93cf-312c32e06bdd tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:26.807148 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-aebaff48-8ffe-4097-93cf-312c32e06bdd tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:26.813290 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-aebaff48-8ffe-4097-93cf-312c32e06bdd tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:26.813746 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-aebaff48-8ffe-4097-93cf-312c32e06bdd tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:26.814521 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-aebaff48-8ffe-4097-93cf-312c32e06bdd tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:26.814965 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-aebaff48-8ffe-4097-93cf-312c32e06bdd tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:26.884547 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-22a1709a-78e6-4c61-a3eb-7ebb23933b8c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28655 microversion: 2.20 time: 0.160830 Aug 27 04:40:26.885681 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 497/1018] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:40:26 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28655 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:40:26.935912 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-aebaff48-8ffe-4097-93cf-312c32e06bdd tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:26.944401 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-aebaff48-8ffe-4097-93cf-312c32e06bdd tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1574 microversion: 2.1 time: 0.141138 Aug 27 04:40:26.944979 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 522/1019] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:40:26 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1574 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:40:27.216053 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-ee52e5af-7711-4327-aaaf-0296dfa3f823 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:27.217645 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-ee52e5af-7711-4327-aaaf-0296dfa3f823 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:27.228810 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ee52e5af-7711-4327-aaaf-0296dfa3f823 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:27.229620 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ee52e5af-7711-4327-aaaf-0296dfa3f823 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:27.230877 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ee52e5af-7711-4327-aaaf-0296dfa3f823 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:27.231929 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ee52e5af-7711-4327-aaaf-0296dfa3f823 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:27.398419 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-ca18ccab-743e-4702-ab09-5a6720fd6a9d tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:27.399130 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-ca18ccab-743e-4702-ab09-5a6720fd6a9d tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [instance: 89e425c1-0168-4f5d-8635-dd6b9f88c580] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:27.404995 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ca18ccab-743e-4702-ab09-5a6720fd6a9d tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:27.405442 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ca18ccab-743e-4702-ab09-5a6720fd6a9d tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:27.406211 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ca18ccab-743e-4702-ab09-5a6720fd6a9d tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:27.406648 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ca18ccab-743e-4702-ab09-5a6720fd6a9d tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:27.423086 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-ee52e5af-7711-4327-aaaf-0296dfa3f823 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 14 microversion: 2.1 time: 0.214515 Aug 27 04:40:27.423864 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 498/1020] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:40:27 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 14 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:40:27.605151 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-ca18ccab-743e-4702-ab09-5a6720fd6a9d tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b01f24964a490da63d33097d0f9a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d957eb500948908f38f0f427a9017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:27.612649 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-ca18ccab-743e-4702-ab09-5a6720fd6a9d tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580" status: 200 len: 1554 microversion: 2.1 time: 0.218552 Aug 27 04:40:27.613218 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 523/1021] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:40:27 2021] GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580 => generated 1554 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:40:27.897623 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-a84e5fbf-150b-4d3b-a208-7eb9598860f4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:27.898628 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-a84e5fbf-150b-4d3b-a208-7eb9598860f4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:27.907320 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a84e5fbf-150b-4d3b-a208-7eb9598860f4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:27.907767 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a84e5fbf-150b-4d3b-a208-7eb9598860f4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:27.908571 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a84e5fbf-150b-4d3b-a208-7eb9598860f4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:27.909002 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a84e5fbf-150b-4d3b-a208-7eb9598860f4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:27.945963 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [req-777a9e97-1ddb-40b0-b229-dd06b4c8af07 req-9daa0e8b-0188-46c8-bd5a-cf27da366940 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89e425c1-0168-4f5d-8635-dd6b9f88c580", "name": "network-vif-deleted", "tag": "6348fecd-7464-4987-a099-9e9f7e860b0c"}]} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:27.947646 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:40:27.947646 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: warnings.warn(msg) Aug 27 04:40:27.954602 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-777a9e97-1ddb-40b0-b229-dd06b4c8af07 req-9daa0e8b-0188-46c8-bd5a-cf27da366940 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:27.956542 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-777a9e97-1ddb-40b0-b229-dd06b4c8af07 req-9daa0e8b-0188-46c8-bd5a-cf27da366940 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:27.969522 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.compute.server_external_events [req-777a9e97-1ddb-40b0-b229-dd06b4c8af07 req-9daa0e8b-0188-46c8-bd5a-cf27da366940 service nova] Creating event network-vif-deleted:6348fecd-7464-4987-a099-9e9f7e860b0c for instance 89e425c1-0168-4f5d-8635-dd6b9f88c580 on hv-cinder-80403 Aug 27 04:40:27.974539 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [req-777a9e97-1ddb-40b0-b229-dd06b4c8af07 req-9daa0e8b-0188-46c8-bd5a-cf27da366940 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034382 Aug 27 04:40:27.975134 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 524/1022] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:40:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:40:27.984226 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-3f71e9f1-2b78-4f96-bbd6-a418873ed6f5 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:27.984754 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-3f71e9f1-2b78-4f96-bbd6-a418873ed6f5 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:27.991078 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3f71e9f1-2b78-4f96-bbd6-a418873ed6f5 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:27.991594 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3f71e9f1-2b78-4f96-bbd6-a418873ed6f5 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:27.992299 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3f71e9f1-2b78-4f96-bbd6-a418873ed6f5 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:27.992729 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3f71e9f1-2b78-4f96-bbd6-a418873ed6f5 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:28.067788 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-a84e5fbf-150b-4d3b-a208-7eb9598860f4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28655 microversion: 2.20 time: 0.174602 Aug 27 04:40:28.070904 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 499/1023] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:40:27 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28655 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:40:28.144493 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-3f71e9f1-2b78-4f96-bbd6-a418873ed6f5 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:28.153279 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-3f71e9f1-2b78-4f96-bbd6-a418873ed6f5 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1561 microversion: 2.1 time: 0.174381 Aug 27 04:40:28.153857 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 525/1024] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:40:27 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1561 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:28.434627 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-c4ff28b0-f94e-4663-858e-cec5a1e5724c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:28.435656 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-c4ff28b0-f94e-4663-858e-cec5a1e5724c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:28.442189 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-c4ff28b0-f94e-4663-858e-cec5a1e5724c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:28.442642 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-c4ff28b0-f94e-4663-858e-cec5a1e5724c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:28.443415 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-c4ff28b0-f94e-4663-858e-cec5a1e5724c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:28.443854 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-c4ff28b0-f94e-4663-858e-cec5a1e5724c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:28.560571 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-c4ff28b0-f94e-4663-858e-cec5a1e5724c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 14 microversion: 2.1 time: 0.129800 Aug 27 04:40:28.561209 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 500/1025] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:40:28 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:40:28.629188 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-b626b930-35f1-444a-b0c4-f13d3558bf9b tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:28.629824 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-b626b930-35f1-444a-b0c4-f13d3558bf9b tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [instance: 89e425c1-0168-4f5d-8635-dd6b9f88c580] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:28.636794 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b626b930-35f1-444a-b0c4-f13d3558bf9b tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:28.637239 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b626b930-35f1-444a-b0c4-f13d3558bf9b tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:28.637988 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b626b930-35f1-444a-b0c4-f13d3558bf9b tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:28.638419 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b626b930-35f1-444a-b0c4-f13d3558bf9b tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:28.669965 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b626b930-35f1-444a-b0c4-f13d3558bf9b tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:28.670337 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b626b930-35f1-444a-b0c4-f13d3558bf9b tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:28.670840 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.objects.instance [None req-b626b930-35f1-444a-b0c4-f13d3558bf9b tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lazy-loading 'fault' on Instance uuid 89e425c1-0168-4f5d-8635-dd6b9f88c580 {{(pid=108971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:40:28.711930 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-b626b930-35f1-444a-b0c4-f13d3558bf9b tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09b01f24964a490da63d33097d0f9a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d957eb500948908f38f0f427a9017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:40:28.719744 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-b626b930-35f1-444a-b0c4-f13d3558bf9b tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580" status: 200 len: 1348 microversion: 2.1 time: 0.094123 Aug 27 04:40:28.720382 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 526/1026] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:40:28 2021] GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580 => generated 1348 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:40:29.081314 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-57b971f9-053a-4b3d-85db-07d1b16be871 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:29.082312 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-57b971f9-053a-4b3d-85db-07d1b16be871 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:29.088949 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-57b971f9-053a-4b3d-85db-07d1b16be871 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:29.089408 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-57b971f9-053a-4b3d-85db-07d1b16be871 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:29.090186 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-57b971f9-053a-4b3d-85db-07d1b16be871 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:29.090625 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-57b971f9-053a-4b3d-85db-07d1b16be871 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:29.220211 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-57b971f9-053a-4b3d-85db-07d1b16be871 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28655 microversion: 2.20 time: 0.142747 Aug 27 04:40:29.221172 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 501/1027] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:40:29 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28655 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:40:29.574008 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-6fba47e2-f1b2-4574-b4d0-29070c9e2a43 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:29.575362 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-6fba47e2-f1b2-4574-b4d0-29070c9e2a43 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:29.581528 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6fba47e2-f1b2-4574-b4d0-29070c9e2a43 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:29.581972 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6fba47e2-f1b2-4574-b4d0-29070c9e2a43 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:29.582733 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6fba47e2-f1b2-4574-b4d0-29070c9e2a43 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:29.583210 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6fba47e2-f1b2-4574-b4d0-29070c9e2a43 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:29.706940 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-6fba47e2-f1b2-4574-b4d0-29070c9e2a43 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 14 microversion: 2.1 time: 0.139011 Aug 27 04:40:29.707963 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 527/1028] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:40:29 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 14 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:40:29.736591 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-bd113c15-68c2-4267-9c9c-6d720df96e9d tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:29.737324 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-bd113c15-68c2-4267-9c9c-6d720df96e9d tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] [instance: 89e425c1-0168-4f5d-8635-dd6b9f88c580] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:29.744489 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-bd113c15-68c2-4267-9c9c-6d720df96e9d tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:29.744940 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-bd113c15-68c2-4267-9c9c-6d720df96e9d tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:29.745711 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-bd113c15-68c2-4267-9c9c-6d720df96e9d tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:29.746152 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-bd113c15-68c2-4267-9c9c-6d720df96e9d tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:29.759201 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.wsgi [None req-bd113c15-68c2-4267-9c9c-6d720df96e9d tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] HTTP exception thrown: Instance 89e425c1-0168-4f5d-8635-dd6b9f88c580 could not be found. Aug 27 04:40:29.759793 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-bd113c15-68c2-4267-9c9c-6d720df96e9d tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Returning 404 to user: Instance 89e425c1-0168-4f5d-8635-dd6b9f88c580 could not be found. {{(pid=108970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:40:29.760625 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-bd113c15-68c2-4267-9c9c-6d720df96e9d tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580" status: 404 len: 111 microversion: 2.1 time: 0.028015 Aug 27 04:40:29.761138 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 502/1029] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:40:29 2021] GET /compute/v2.1/servers/89e425c1-0168-4f5d-8635-dd6b9f88c580 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:40:29.769444 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-3a3fe67d-a357-4519-bf23-3609fc5cb524 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] Calling method '.version_select at 0x7f20785fb670>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:40:29.788217 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-3a3fe67d-a357-4519-bf23-3609fc5cb524 tempest-TestMinimumBasicScenario-1749454073 tempest-TestMinimumBasicScenario-1749454073-project] 10.222.0.53 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1307425937" status: 202 len: 0 microversion: 2.1 time: 0.022608 Aug 27 04:40:29.788774 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 528/1030] 10.222.0.53 () {58 vars in 1272 bytes} [Fri Aug 27 04:40:29 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1307425937 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:40:30.233303 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-b574210a-154e-4820-9f94-d79895fd776d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:30.235205 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-b574210a-154e-4820-9f94-d79895fd776d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:30.241535 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b574210a-154e-4820-9f94-d79895fd776d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:30.242061 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b574210a-154e-4820-9f94-d79895fd776d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:30.243291 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b574210a-154e-4820-9f94-d79895fd776d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:30.243804 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b574210a-154e-4820-9f94-d79895fd776d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:30.280578 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [req-1de70537-cb77-4a6b-986b-89750218d073 req-2816e73a-8a95-4ded-adc9-00bfea33267c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2051c4e-353b-4875-8217-513125bcaf66", "name": "network-vif-plugged", "status": "completed", "tag": "236b6127-484d-477e-b8eb-9cc2f556a39e"}]} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:30.280578 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:40:30.280578 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: warnings.warn(msg) Aug 27 04:40:30.289392 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-1de70537-cb77-4a6b-986b-89750218d073 req-2816e73a-8a95-4ded-adc9-00bfea33267c service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:30.290234 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-1de70537-cb77-4a6b-986b-89750218d073 req-2816e73a-8a95-4ded-adc9-00bfea33267c service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:30.303098 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.compute.server_external_events [req-1de70537-cb77-4a6b-986b-89750218d073 req-2816e73a-8a95-4ded-adc9-00bfea33267c service nova] Creating event network-vif-plugged:236b6127-484d-477e-b8eb-9cc2f556a39e for instance e2051c4e-353b-4875-8217-513125bcaf66 on hv-cinder-80403 Aug 27 04:40:30.308713 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [req-1de70537-cb77-4a6b-986b-89750218d073 req-2816e73a-8a95-4ded-adc9-00bfea33267c service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033647 Aug 27 04:40:30.309632 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 529/1031] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:40:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:40:30.391163 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-b574210a-154e-4820-9f94-d79895fd776d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28655 microversion: 2.20 time: 0.162664 Aug 27 04:40:30.392400 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 503/1032] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:40:30 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28655 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:40:30.718720 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-60de9858-8a5b-47af-b386-a3ec69f03363 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:30.719787 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-60de9858-8a5b-47af-b386-a3ec69f03363 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:30.726120 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-60de9858-8a5b-47af-b386-a3ec69f03363 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:30.726565 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-60de9858-8a5b-47af-b386-a3ec69f03363 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:30.727579 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-60de9858-8a5b-47af-b386-a3ec69f03363 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:30.728113 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-60de9858-8a5b-47af-b386-a3ec69f03363 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:30.828392 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-60de9858-8a5b-47af-b386-a3ec69f03363 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 14 microversion: 2.1 time: 0.113503 Aug 27 04:40:30.831532 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 530/1033] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:40:30 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:40:31.404173 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-65f43c13-ef0c-4291-8a2b-9dce1dd69d8a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:31.405176 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-65f43c13-ef0c-4291-8a2b-9dce1dd69d8a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:31.412450 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-65f43c13-ef0c-4291-8a2b-9dce1dd69d8a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:31.412851 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-65f43c13-ef0c-4291-8a2b-9dce1dd69d8a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:31.415416 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-65f43c13-ef0c-4291-8a2b-9dce1dd69d8a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:31.417164 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-65f43c13-ef0c-4291-8a2b-9dce1dd69d8a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:31.511150 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-65f43c13-ef0c-4291-8a2b-9dce1dd69d8a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28655 microversion: 2.20 time: 0.111280 Aug 27 04:40:31.511810 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 504/1034] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:40:31 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28655 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:40:31.840407 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-5988a9d4-3c20-4a89-bfd5-b6cdcf122322 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:31.841508 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-5988a9d4-3c20-4a89-bfd5-b6cdcf122322 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:31.847938 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5988a9d4-3c20-4a89-bfd5-b6cdcf122322 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:31.848408 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5988a9d4-3c20-4a89-bfd5-b6cdcf122322 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:31.849170 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5988a9d4-3c20-4a89-bfd5-b6cdcf122322 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:31.849605 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5988a9d4-3c20-4a89-bfd5-b6cdcf122322 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:31.930662 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-5988a9d4-3c20-4a89-bfd5-b6cdcf122322 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 14 microversion: 2.1 time: 0.094151 Aug 27 04:40:31.931298 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 531/1035] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:40:31 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 04:40:32.523460 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-c8a5d089-ce89-454d-a27d-1e9d9287c51d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:32.524509 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-c8a5d089-ce89-454d-a27d-1e9d9287c51d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:32.531198 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-c8a5d089-ce89-454d-a27d-1e9d9287c51d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:32.531867 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-c8a5d089-ce89-454d-a27d-1e9d9287c51d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:32.532675 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-c8a5d089-ce89-454d-a27d-1e9d9287c51d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:32.533113 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-c8a5d089-ce89-454d-a27d-1e9d9287c51d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:32.632067 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-c8a5d089-ce89-454d-a27d-1e9d9287c51d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28655 microversion: 2.20 time: 0.112422 Aug 27 04:40:32.632632 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 505/1036] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:40:32 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28655 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:40:32.943550 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-bf6b2f1e-d9cf-4274-943f-e4c90b45fdd5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:32.944580 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-bf6b2f1e-d9cf-4274-943f-e4c90b45fdd5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:32.952507 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-bf6b2f1e-d9cf-4274-943f-e4c90b45fdd5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:32.953435 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-bf6b2f1e-d9cf-4274-943f-e4c90b45fdd5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:32.954876 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-bf6b2f1e-d9cf-4274-943f-e4c90b45fdd5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:32.955505 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-bf6b2f1e-d9cf-4274-943f-e4c90b45fdd5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:33.054256 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-bf6b2f1e-d9cf-4274-943f-e4c90b45fdd5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 14 microversion: 2.1 time: 0.115103 Aug 27 04:40:33.055375 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 532/1037] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:40:32 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 04:40:33.645620 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-fa71e1f5-21c9-4d51-bd59-6c13c8ff3e29 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:33.647364 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-fa71e1f5-21c9-4d51-bd59-6c13c8ff3e29 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:33.653992 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fa71e1f5-21c9-4d51-bd59-6c13c8ff3e29 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:33.654449 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fa71e1f5-21c9-4d51-bd59-6c13c8ff3e29 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:33.655242 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fa71e1f5-21c9-4d51-bd59-6c13c8ff3e29 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:33.655685 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fa71e1f5-21c9-4d51-bd59-6c13c8ff3e29 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:33.760454 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-fa71e1f5-21c9-4d51-bd59-6c13c8ff3e29 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28655 microversion: 2.20 time: 0.118715 Aug 27 04:40:33.764988 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 506/1038] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:40:33 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28655 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:40:34.065611 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-35ec2dbd-3843-46fa-b1c4-ffa88b43736a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:34.067300 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-35ec2dbd-3843-46fa-b1c4-ffa88b43736a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:34.074602 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-35ec2dbd-3843-46fa-b1c4-ffa88b43736a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:34.075054 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-35ec2dbd-3843-46fa-b1c4-ffa88b43736a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:34.075845 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-35ec2dbd-3843-46fa-b1c4-ffa88b43736a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:34.076314 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-35ec2dbd-3843-46fa-b1c4-ffa88b43736a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:34.175916 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-35ec2dbd-3843-46fa-b1c4-ffa88b43736a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 14 microversion: 2.1 time: 0.113724 Aug 27 04:40:34.177051 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 533/1039] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:40:34 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 04:40:34.774765 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-ee596a16-8221-47d1-902c-46eef2d0b6cd tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:34.775772 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-ee596a16-8221-47d1-902c-46eef2d0b6cd tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:34.782508 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ee596a16-8221-47d1-902c-46eef2d0b6cd tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:34.783236 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ee596a16-8221-47d1-902c-46eef2d0b6cd tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:34.784132 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ee596a16-8221-47d1-902c-46eef2d0b6cd tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:34.784492 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ee596a16-8221-47d1-902c-46eef2d0b6cd tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:34.904401 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-ee596a16-8221-47d1-902c-46eef2d0b6cd tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28655 microversion: 2.20 time: 0.134897 Aug 27 04:40:34.905084 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 507/1040] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:40:34 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28655 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:40:35.188458 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-b1ef2dda-cea5-4ee8-892f-2da49ee657ee tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:35.189445 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-b1ef2dda-cea5-4ee8-892f-2da49ee657ee tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:35.196549 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b1ef2dda-cea5-4ee8-892f-2da49ee657ee tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:35.196993 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b1ef2dda-cea5-4ee8-892f-2da49ee657ee tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:35.197756 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b1ef2dda-cea5-4ee8-892f-2da49ee657ee tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:35.198185 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b1ef2dda-cea5-4ee8-892f-2da49ee657ee tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:35.286987 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-b1ef2dda-cea5-4ee8-892f-2da49ee657ee tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 14 microversion: 2.1 time: 0.102407 Aug 27 04:40:35.287904 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 534/1041] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:40:35 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:40:35.917798 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-18abe125-ba57-4afe-ae1a-37be8502a830 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:35.918804 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-18abe125-ba57-4afe-ae1a-37be8502a830 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:35.925445 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-18abe125-ba57-4afe-ae1a-37be8502a830 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:35.925961 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-18abe125-ba57-4afe-ae1a-37be8502a830 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:35.926787 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-18abe125-ba57-4afe-ae1a-37be8502a830 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:35.927277 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-18abe125-ba57-4afe-ae1a-37be8502a830 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:36.022677 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-18abe125-ba57-4afe-ae1a-37be8502a830 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28655 microversion: 2.20 time: 0.108789 Aug 27 04:40:36.028522 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 508/1042] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:40:35 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28655 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:40:36.306023 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-e619742e-7479-430b-9293-b0a2c9f6d42c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:36.308016 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-e619742e-7479-430b-9293-b0a2c9f6d42c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:36.315844 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e619742e-7479-430b-9293-b0a2c9f6d42c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:36.316877 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e619742e-7479-430b-9293-b0a2c9f6d42c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:36.318895 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e619742e-7479-430b-9293-b0a2c9f6d42c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:36.319864 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e619742e-7479-430b-9293-b0a2c9f6d42c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:36.489379 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-e619742e-7479-430b-9293-b0a2c9f6d42c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 14 microversion: 2.1 time: 0.193171 Aug 27 04:40:36.490034 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 535/1043] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:40:36 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 14 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:40:37.041566 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-3e00bf7b-bf2b-44ac-86a7-22de04a70102 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:37.043066 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-3e00bf7b-bf2b-44ac-86a7-22de04a70102 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:37.054464 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3e00bf7b-bf2b-44ac-86a7-22de04a70102 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:37.055250 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3e00bf7b-bf2b-44ac-86a7-22de04a70102 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:37.056656 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3e00bf7b-bf2b-44ac-86a7-22de04a70102 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:37.057433 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3e00bf7b-bf2b-44ac-86a7-22de04a70102 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:37.177055 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-3e00bf7b-bf2b-44ac-86a7-22de04a70102 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28655 microversion: 2.20 time: 0.141977 Aug 27 04:40:37.178676 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 509/1044] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:40:37 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28655 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:40:37.505684 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-9d745ec7-5d09-4dd9-8292-cc94e39759af tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:37.507513 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-9d745ec7-5d09-4dd9-8292-cc94e39759af tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:37.518099 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9d745ec7-5d09-4dd9-8292-cc94e39759af tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:37.518880 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9d745ec7-5d09-4dd9-8292-cc94e39759af tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:37.520263 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9d745ec7-5d09-4dd9-8292-cc94e39759af tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:37.521338 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9d745ec7-5d09-4dd9-8292-cc94e39759af tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:37.648450 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-9d745ec7-5d09-4dd9-8292-cc94e39759af tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 9954 microversion: 2.1 time: 0.150243 Aug 27 04:40:37.649950 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 536/1045] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:40:37 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 9954 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:40:38.192218 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-014f0f36-7c98-4c5b-b734-29677d3993f9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:38.193822 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-014f0f36-7c98-4c5b-b734-29677d3993f9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:38.200404 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-014f0f36-7c98-4c5b-b734-29677d3993f9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:38.200895 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-014f0f36-7c98-4c5b-b734-29677d3993f9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:38.201667 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-014f0f36-7c98-4c5b-b734-29677d3993f9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:38.202105 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-014f0f36-7c98-4c5b-b734-29677d3993f9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:38.295667 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-014f0f36-7c98-4c5b-b734-29677d3993f9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28655 microversion: 2.20 time: 0.107270 Aug 27 04:40:38.296369 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 510/1046] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:40:38 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28655 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:40:38.662060 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-71021f80-1a09-4321-b18d-d838a8d744d7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:38.662985 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-71021f80-1a09-4321-b18d-d838a8d744d7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:38.669432 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-71021f80-1a09-4321-b18d-d838a8d744d7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:38.669872 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-71021f80-1a09-4321-b18d-d838a8d744d7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:38.670628 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-71021f80-1a09-4321-b18d-d838a8d744d7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:38.671053 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-71021f80-1a09-4321-b18d-d838a8d744d7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:38.784615 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-71021f80-1a09-4321-b18d-d838a8d744d7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 16486 microversion: 2.1 time: 0.126975 Aug 27 04:40:38.785271 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 537/1047] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:40:38 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 16486 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:40:39.308044 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-0eb916ae-a276-460c-ada3-481ce616c29c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:39.309071 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-0eb916ae-a276-460c-ada3-481ce616c29c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:39.315560 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0eb916ae-a276-460c-ada3-481ce616c29c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:39.316036 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0eb916ae-a276-460c-ada3-481ce616c29c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:39.316811 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0eb916ae-a276-460c-ada3-481ce616c29c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:39.317258 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0eb916ae-a276-460c-ada3-481ce616c29c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:39.411076 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-0eb916ae-a276-460c-ada3-481ce616c29c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28655 microversion: 2.20 time: 0.107001 Aug 27 04:40:39.412126 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 511/1048] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:40:39 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28655 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:40:39.797603 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-04d04328-a554-400c-b1fa-b496c1ac9261 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:39.798595 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-04d04328-a554-400c-b1fa-b496c1ac9261 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:39.805689 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-04d04328-a554-400c-b1fa-b496c1ac9261 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:39.806137 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-04d04328-a554-400c-b1fa-b496c1ac9261 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:39.806901 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-04d04328-a554-400c-b1fa-b496c1ac9261 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:39.807333 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-04d04328-a554-400c-b1fa-b496c1ac9261 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:39.915113 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-04d04328-a554-400c-b1fa-b496c1ac9261 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 18449 microversion: 2.1 time: 0.121404 Aug 27 04:40:39.915752 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 538/1049] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:40:39 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 18449 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:40:40.423890 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-284226eb-50e8-40e3-b7d5-a4759a7bc5e0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:40.425028 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-284226eb-50e8-40e3-b7d5-a4759a7bc5e0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:40.431591 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-284226eb-50e8-40e3-b7d5-a4759a7bc5e0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:40.432079 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-284226eb-50e8-40e3-b7d5-a4759a7bc5e0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:40.432855 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-284226eb-50e8-40e3-b7d5-a4759a7bc5e0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:40.433291 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-284226eb-50e8-40e3-b7d5-a4759a7bc5e0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:40.540918 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-284226eb-50e8-40e3-b7d5-a4759a7bc5e0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28655 microversion: 2.20 time: 0.121241 Aug 27 04:40:40.541561 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 512/1050] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:40:40 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28655 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:40:40.927192 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-c08a02ba-8b31-4ca0-8bbb-162833c02ffc tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:40.928215 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-c08a02ba-8b31-4ca0-8bbb-162833c02ffc tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:40.935042 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c08a02ba-8b31-4ca0-8bbb-162833c02ffc tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:40.935490 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c08a02ba-8b31-4ca0-8bbb-162833c02ffc tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:40.936413 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c08a02ba-8b31-4ca0-8bbb-162833c02ffc tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:40.936880 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c08a02ba-8b31-4ca0-8bbb-162833c02ffc tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:41.045868 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-c08a02ba-8b31-4ca0-8bbb-162833c02ffc tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 20757 microversion: 2.1 time: 0.118836 Aug 27 04:40:41.047353 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 539/1051] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:40:40 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 20757 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:40:41.553854 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-67167fe7-2f51-45a3-8594-6a4e1b095414 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:41.554838 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-67167fe7-2f51-45a3-8594-6a4e1b095414 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:41.561363 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-67167fe7-2f51-45a3-8594-6a4e1b095414 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:41.561807 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-67167fe7-2f51-45a3-8594-6a4e1b095414 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:41.562587 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-67167fe7-2f51-45a3-8594-6a4e1b095414 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:41.563003 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-67167fe7-2f51-45a3-8594-6a4e1b095414 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:41.661823 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-67167fe7-2f51-45a3-8594-6a4e1b095414 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28655 microversion: 2.20 time: 0.111715 Aug 27 04:40:41.663871 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 513/1052] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:40:41 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28655 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:40:42.059338 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-9e3c082d-c613-4a1b-8241-45cd175f4693 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:42.060360 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-9e3c082d-c613-4a1b-8241-45cd175f4693 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:42.066988 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9e3c082d-c613-4a1b-8241-45cd175f4693 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:42.067445 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9e3c082d-c613-4a1b-8241-45cd175f4693 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:42.068253 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9e3c082d-c613-4a1b-8241-45cd175f4693 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:42.068699 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9e3c082d-c613-4a1b-8241-45cd175f4693 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:42.176404 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-9e3c082d-c613-4a1b-8241-45cd175f4693 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 22896 microversion: 2.1 time: 0.120906 Aug 27 04:40:42.177100 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 540/1053] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:40:42 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 22896 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:40:42.677590 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-84a37ffe-3c3d-468e-beb1-16a10a579846 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:42.678495 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-84a37ffe-3c3d-468e-beb1-16a10a579846 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:42.684967 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-84a37ffe-3c3d-468e-beb1-16a10a579846 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:42.685405 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-84a37ffe-3c3d-468e-beb1-16a10a579846 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:42.686164 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-84a37ffe-3c3d-468e-beb1-16a10a579846 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:42.686595 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-84a37ffe-3c3d-468e-beb1-16a10a579846 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:42.788976 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-84a37ffe-3c3d-468e-beb1-16a10a579846 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28655 microversion: 2.20 time: 0.116215 Aug 27 04:40:42.789947 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 514/1054] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:40:42 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28655 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:40:43.188472 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-cd581942-2491-47ee-aa33-bd27168b445d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:43.189474 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-cd581942-2491-47ee-aa33-bd27168b445d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:43.196467 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cd581942-2491-47ee-aa33-bd27168b445d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:43.196977 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cd581942-2491-47ee-aa33-bd27168b445d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:43.197788 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cd581942-2491-47ee-aa33-bd27168b445d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:43.198273 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cd581942-2491-47ee-aa33-bd27168b445d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:43.316213 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-cd581942-2491-47ee-aa33-bd27168b445d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 23803 microversion: 2.1 time: 0.131672 Aug 27 04:40:43.317539 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 541/1055] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:40:43 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 23803 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:40:43.801706 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-df539f74-78bc-4637-b878-2b07dda8e2b5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:43.803299 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-df539f74-78bc-4637-b878-2b07dda8e2b5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:43.810072 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-df539f74-78bc-4637-b878-2b07dda8e2b5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:43.810517 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-df539f74-78bc-4637-b878-2b07dda8e2b5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:43.811284 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-df539f74-78bc-4637-b878-2b07dda8e2b5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:43.811752 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-df539f74-78bc-4637-b878-2b07dda8e2b5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:43.907797 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-df539f74-78bc-4637-b878-2b07dda8e2b5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28655 microversion: 2.20 time: 0.110143 Aug 27 04:40:43.908551 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 515/1056] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:40:43 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28655 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:40:44.329213 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-a8fdc7da-c841-4953-8a08-2fdbcfee2c8d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:44.330200 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-a8fdc7da-c841-4953-8a08-2fdbcfee2c8d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:44.337600 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a8fdc7da-c841-4953-8a08-2fdbcfee2c8d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:44.338051 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a8fdc7da-c841-4953-8a08-2fdbcfee2c8d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:44.338831 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a8fdc7da-c841-4953-8a08-2fdbcfee2c8d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:44.339272 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a8fdc7da-c841-4953-8a08-2fdbcfee2c8d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:44.443313 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-a8fdc7da-c841-4953-8a08-2fdbcfee2c8d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 25029 microversion: 2.1 time: 0.117718 Aug 27 04:40:44.444233 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 542/1057] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:40:44 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 25029 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:40:44.920807 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-615173de-af45-4f20-a4d4-07b00e86b220 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:44.921801 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-615173de-af45-4f20-a4d4-07b00e86b220 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:44.928940 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-615173de-af45-4f20-a4d4-07b00e86b220 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:44.929440 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-615173de-af45-4f20-a4d4-07b00e86b220 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:44.930424 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-615173de-af45-4f20-a4d4-07b00e86b220 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:44.930954 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-615173de-af45-4f20-a4d4-07b00e86b220 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:45.039635 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-615173de-af45-4f20-a4d4-07b00e86b220 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28655 microversion: 2.20 time: 0.122730 Aug 27 04:40:45.040335 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 516/1058] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:40:44 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28655 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:40:45.455751 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-5ff35d19-f780-461c-b172-98592834711d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:45.456775 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-5ff35d19-f780-461c-b172-98592834711d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:45.464950 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5ff35d19-f780-461c-b172-98592834711d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:45.465520 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5ff35d19-f780-461c-b172-98592834711d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:45.466413 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5ff35d19-f780-461c-b172-98592834711d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:45.466970 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5ff35d19-f780-461c-b172-98592834711d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:45.594547 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-5ff35d19-f780-461c-b172-98592834711d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 26251 microversion: 2.1 time: 0.142620 Aug 27 04:40:45.595439 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 543/1059] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:40:45 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 26251 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:40:46.052170 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-018dcb3a-078a-4524-95ba-aa36ec39730c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:46.053172 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-018dcb3a-078a-4524-95ba-aa36ec39730c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:46.059742 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-018dcb3a-078a-4524-95ba-aa36ec39730c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:46.060250 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-018dcb3a-078a-4524-95ba-aa36ec39730c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:46.062093 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-018dcb3a-078a-4524-95ba-aa36ec39730c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:46.062093 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-018dcb3a-078a-4524-95ba-aa36ec39730c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:46.174516 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-018dcb3a-078a-4524-95ba-aa36ec39730c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28655 microversion: 2.20 time: 0.126258 Aug 27 04:40:46.175180 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 517/1060] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:40:46 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28655 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:40:46.607658 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-384999d1-de4f-417d-811d-4e57e83bb6f5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:46.608688 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-384999d1-de4f-417d-811d-4e57e83bb6f5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:46.615888 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-384999d1-de4f-417d-811d-4e57e83bb6f5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:46.616207 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-384999d1-de4f-417d-811d-4e57e83bb6f5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:46.616986 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-384999d1-de4f-417d-811d-4e57e83bb6f5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:46.617426 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-384999d1-de4f-417d-811d-4e57e83bb6f5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:46.752896 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-384999d1-de4f-417d-811d-4e57e83bb6f5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 27133 microversion: 2.1 time: 0.149392 Aug 27 04:40:46.753548 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 544/1061] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:40:46 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 27133 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:40:47.186849 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-b21a2146-86d9-47f4-870a-7d6c83f1b06a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:47.187748 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-b21a2146-86d9-47f4-870a-7d6c83f1b06a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:47.194997 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b21a2146-86d9-47f4-870a-7d6c83f1b06a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:47.195528 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b21a2146-86d9-47f4-870a-7d6c83f1b06a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:47.196245 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b21a2146-86d9-47f4-870a-7d6c83f1b06a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:47.196679 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b21a2146-86d9-47f4-870a-7d6c83f1b06a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:47.294665 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-b21a2146-86d9-47f4-870a-7d6c83f1b06a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28655 microversion: 2.20 time: 0.111784 Aug 27 04:40:47.295608 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 518/1062] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:40:47 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28655 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:40:47.765561 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-3982fefc-d671-4fbd-9a92-fea2798f439b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:47.766661 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-3982fefc-d671-4fbd-9a92-fea2798f439b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:47.773771 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3982fefc-d671-4fbd-9a92-fea2798f439b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:47.774212 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3982fefc-d671-4fbd-9a92-fea2798f439b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:47.774965 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3982fefc-d671-4fbd-9a92-fea2798f439b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:47.775391 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3982fefc-d671-4fbd-9a92-fea2798f439b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:47.890638 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-3982fefc-d671-4fbd-9a92-fea2798f439b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 27641 microversion: 2.1 time: 0.128898 Aug 27 04:40:47.891439 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 545/1063] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:40:47 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 27641 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:40:48.307537 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-11d477ed-66c4-4988-b3f3-309e4157008d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:48.308556 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-11d477ed-66c4-4988-b3f3-309e4157008d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:48.315131 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-11d477ed-66c4-4988-b3f3-309e4157008d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:48.315580 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-11d477ed-66c4-4988-b3f3-309e4157008d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:48.316377 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-11d477ed-66c4-4988-b3f3-309e4157008d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:48.316815 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-11d477ed-66c4-4988-b3f3-309e4157008d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:48.433706 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-11d477ed-66c4-4988-b3f3-309e4157008d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28655 microversion: 2.20 time: 0.130086 Aug 27 04:40:48.434386 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 519/1064] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:40:48 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28655 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:40:48.902956 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-bd420f74-f936-49b9-8613-ce6a5e68aa15 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:48.903942 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-bd420f74-f936-49b9-8613-ce6a5e68aa15 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:48.910542 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-bd420f74-f936-49b9-8613-ce6a5e68aa15 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:48.911478 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-bd420f74-f936-49b9-8613-ce6a5e68aa15 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:48.912264 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-bd420f74-f936-49b9-8613-ce6a5e68aa15 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:48.912701 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-bd420f74-f936-49b9-8613-ce6a5e68aa15 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:49.037817 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-bd420f74-f936-49b9-8613-ce6a5e68aa15 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 27891 microversion: 2.1 time: 0.138691 Aug 27 04:40:49.038471 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 546/1065] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:40:48 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 27891 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:40:49.445966 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-a6818f99-5615-485a-81e6-7f8d3a8135eb tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:49.446958 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-a6818f99-5615-485a-81e6-7f8d3a8135eb tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:49.453546 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a6818f99-5615-485a-81e6-7f8d3a8135eb tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:49.454000 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a6818f99-5615-485a-81e6-7f8d3a8135eb tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:49.454772 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a6818f99-5615-485a-81e6-7f8d3a8135eb tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:49.455209 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a6818f99-5615-485a-81e6-7f8d3a8135eb tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:49.559002 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-a6818f99-5615-485a-81e6-7f8d3a8135eb tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28655 microversion: 2.20 time: 0.116983 Aug 27 04:40:49.559702 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 520/1066] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:40:49 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28655 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:40:50.050322 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-6b4de7bf-df8c-470e-9d08-4ede6ed0204d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:50.051339 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-6b4de7bf-df8c-470e-9d08-4ede6ed0204d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:50.058371 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6b4de7bf-df8c-470e-9d08-4ede6ed0204d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:50.058816 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6b4de7bf-df8c-470e-9d08-4ede6ed0204d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:50.059580 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6b4de7bf-df8c-470e-9d08-4ede6ed0204d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:50.060039 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6b4de7bf-df8c-470e-9d08-4ede6ed0204d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:50.199591 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-6b4de7bf-df8c-470e-9d08-4ede6ed0204d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28069 microversion: 2.1 time: 0.153169 Aug 27 04:40:50.200519 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 547/1067] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:40:50 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28069 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:40:50.571679 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-14dc912b-d554-4762-bf5f-a6abae56d763 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:50.572713 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-14dc912b-d554-4762-bf5f-a6abae56d763 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:50.579509 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-14dc912b-d554-4762-bf5f-a6abae56d763 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:50.579965 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-14dc912b-d554-4762-bf5f-a6abae56d763 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:50.580759 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-14dc912b-d554-4762-bf5f-a6abae56d763 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:50.581197 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-14dc912b-d554-4762-bf5f-a6abae56d763 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:50.681747 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-14dc912b-d554-4762-bf5f-a6abae56d763 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28655 microversion: 2.20 time: 0.114156 Aug 27 04:40:50.682329 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 521/1068] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:40:50 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28655 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:40:51.212485 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-33d9bf09-cb7c-48d5-996e-3f43bce28756 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:51.213508 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-33d9bf09-cb7c-48d5-996e-3f43bce28756 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:51.220145 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-33d9bf09-cb7c-48d5-996e-3f43bce28756 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:51.220589 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-33d9bf09-cb7c-48d5-996e-3f43bce28756 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:51.221360 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-33d9bf09-cb7c-48d5-996e-3f43bce28756 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:51.221826 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-33d9bf09-cb7c-48d5-996e-3f43bce28756 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:51.330007 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-33d9bf09-cb7c-48d5-996e-3f43bce28756 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28069 microversion: 2.1 time: 0.122062 Aug 27 04:40:51.330672 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 548/1069] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:40:51 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28069 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:40:51.694004 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-9f552e8c-bf67-4e0d-8d80-c3981da4880d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:51.694981 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-9f552e8c-bf67-4e0d-8d80-c3981da4880d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:51.701718 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9f552e8c-bf67-4e0d-8d80-c3981da4880d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:51.702164 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9f552e8c-bf67-4e0d-8d80-c3981da4880d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:51.702919 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9f552e8c-bf67-4e0d-8d80-c3981da4880d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:51.703350 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9f552e8c-bf67-4e0d-8d80-c3981da4880d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:51.803671 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-9f552e8c-bf67-4e0d-8d80-c3981da4880d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28655 microversion: 2.20 time: 0.114209 Aug 27 04:40:51.804354 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 522/1070] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:40:51 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28655 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:40:52.344625 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-918ed69b-28ff-4213-8752-fd3cf1f52ecd tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:52.346159 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-918ed69b-28ff-4213-8752-fd3cf1f52ecd tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:52.354956 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-918ed69b-28ff-4213-8752-fd3cf1f52ecd tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:52.355619 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-918ed69b-28ff-4213-8752-fd3cf1f52ecd tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:52.357081 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-918ed69b-28ff-4213-8752-fd3cf1f52ecd tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:52.357739 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-918ed69b-28ff-4213-8752-fd3cf1f52ecd tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:52.463428 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-918ed69b-28ff-4213-8752-fd3cf1f52ecd tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28186 microversion: 2.1 time: 0.124530 Aug 27 04:40:52.464063 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 549/1071] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:40:52 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28186 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:40:52.815261 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-5a6f6fcd-1c25-45fc-a5da-927460ec34ea tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:52.816288 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-5a6f6fcd-1c25-45fc-a5da-927460ec34ea tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:52.823362 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5a6f6fcd-1c25-45fc-a5da-927460ec34ea tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:52.823815 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5a6f6fcd-1c25-45fc-a5da-927460ec34ea tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:52.824611 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5a6f6fcd-1c25-45fc-a5da-927460ec34ea tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:52.825051 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5a6f6fcd-1c25-45fc-a5da-927460ec34ea tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:52.918819 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-5a6f6fcd-1c25-45fc-a5da-927460ec34ea tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28655 microversion: 2.20 time: 0.107489 Aug 27 04:40:52.919681 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 523/1072] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:40:52 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28655 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:40:53.475951 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-77c142e7-9a0e-404d-8796-10d401ff729a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:53.476957 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-77c142e7-9a0e-404d-8796-10d401ff729a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:53.483673 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-77c142e7-9a0e-404d-8796-10d401ff729a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:53.484145 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-77c142e7-9a0e-404d-8796-10d401ff729a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:53.484898 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-77c142e7-9a0e-404d-8796-10d401ff729a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:53.485324 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-77c142e7-9a0e-404d-8796-10d401ff729a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:53.608615 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-77c142e7-9a0e-404d-8796-10d401ff729a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28186 microversion: 2.1 time: 0.136993 Aug 27 04:40:53.609228 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 550/1073] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:40:53 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28186 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:40:53.930851 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-34e640e3-5f02-4290-9dd6-97f964a39fe1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:53.931833 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-34e640e3-5f02-4290-9dd6-97f964a39fe1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:53.938480 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-34e640e3-5f02-4290-9dd6-97f964a39fe1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:53.939025 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-34e640e3-5f02-4290-9dd6-97f964a39fe1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:53.939822 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-34e640e3-5f02-4290-9dd6-97f964a39fe1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:53.940382 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-34e640e3-5f02-4290-9dd6-97f964a39fe1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:54.186684 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-34e640e3-5f02-4290-9dd6-97f964a39fe1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28655 microversion: 2.20 time: 0.259582 Aug 27 04:40:54.187320 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 524/1074] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:40:53 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28655 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:40:54.621321 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-6d65e018-976b-400c-9be9-cdfc84ad8428 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:54.622332 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-6d65e018-976b-400c-9be9-cdfc84ad8428 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:54.628771 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6d65e018-976b-400c-9be9-cdfc84ad8428 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:54.629210 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6d65e018-976b-400c-9be9-cdfc84ad8428 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:54.630652 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6d65e018-976b-400c-9be9-cdfc84ad8428 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:54.631079 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6d65e018-976b-400c-9be9-cdfc84ad8428 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:54.750697 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-6d65e018-976b-400c-9be9-cdfc84ad8428 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28186 microversion: 2.1 time: 0.133183 Aug 27 04:40:54.751589 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 551/1075] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:40:54 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28186 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:40:55.198797 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-1efbcf7c-c2c7-44bc-a0e9-fdb69308b7a5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:55.199780 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-1efbcf7c-c2c7-44bc-a0e9-fdb69308b7a5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:55.206187 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1efbcf7c-c2c7-44bc-a0e9-fdb69308b7a5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:55.206632 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1efbcf7c-c2c7-44bc-a0e9-fdb69308b7a5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:55.207389 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1efbcf7c-c2c7-44bc-a0e9-fdb69308b7a5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:55.207817 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1efbcf7c-c2c7-44bc-a0e9-fdb69308b7a5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:55.320092 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-1efbcf7c-c2c7-44bc-a0e9-fdb69308b7a5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28655 microversion: 2.20 time: 0.125086 Aug 27 04:40:55.321020 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 525/1076] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:40:55 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28655 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:40:55.763392 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-7fbce394-024e-4232-928e-187b6f986de7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:55.764398 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-7fbce394-024e-4232-928e-187b6f986de7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:55.771534 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7fbce394-024e-4232-928e-187b6f986de7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:55.771973 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7fbce394-024e-4232-928e-187b6f986de7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:55.772741 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7fbce394-024e-4232-928e-187b6f986de7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:55.773169 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7fbce394-024e-4232-928e-187b6f986de7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:55.864325 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-7fbce394-024e-4232-928e-187b6f986de7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28186 microversion: 2.1 time: 0.104765 Aug 27 04:40:55.864952 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 552/1077] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:40:55 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28186 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:40:56.332414 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-cb13b040-51bf-4408-b650-7451aa188e0b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:56.333324 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-cb13b040-51bf-4408-b650-7451aa188e0b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:56.339905 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-cb13b040-51bf-4408-b650-7451aa188e0b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:56.340394 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-cb13b040-51bf-4408-b650-7451aa188e0b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:56.341178 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-cb13b040-51bf-4408-b650-7451aa188e0b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:56.341621 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-cb13b040-51bf-4408-b650-7451aa188e0b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:56.441764 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-cb13b040-51bf-4408-b650-7451aa188e0b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28655 microversion: 2.20 time: 0.113379 Aug 27 04:40:56.442431 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 526/1078] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:40:56 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28655 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:40:56.876521 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-b440f8d4-34c3-4d31-b7d5-f567f5846767 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:56.877536 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-b440f8d4-34c3-4d31-b7d5-f567f5846767 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:56.884048 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b440f8d4-34c3-4d31-b7d5-f567f5846767 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:56.884496 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b440f8d4-34c3-4d31-b7d5-f567f5846767 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:56.885252 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b440f8d4-34c3-4d31-b7d5-f567f5846767 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:56.885684 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b440f8d4-34c3-4d31-b7d5-f567f5846767 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:56.995147 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-b440f8d4-34c3-4d31-b7d5-f567f5846767 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28186 microversion: 2.1 time: 0.122447 Aug 27 04:40:56.995800 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 553/1079] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:40:56 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28186 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:40:57.454652 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-3405580c-34f8-4f9e-bd62-f217ee428911 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:57.455651 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-3405580c-34f8-4f9e-bd62-f217ee428911 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:57.462173 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3405580c-34f8-4f9e-bd62-f217ee428911 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:57.462626 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3405580c-34f8-4f9e-bd62-f217ee428911 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:57.463392 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3405580c-34f8-4f9e-bd62-f217ee428911 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:57.463829 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3405580c-34f8-4f9e-bd62-f217ee428911 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:57.560706 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-3405580c-34f8-4f9e-bd62-f217ee428911 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28655 microversion: 2.20 time: 0.109977 Aug 27 04:40:57.561382 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 527/1080] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:40:57 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28655 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:40:58.007793 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-d5c0dc8c-99e0-4d28-b884-6ed22ccebedf tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:58.008818 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-d5c0dc8c-99e0-4d28-b884-6ed22ccebedf tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:58.015279 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d5c0dc8c-99e0-4d28-b884-6ed22ccebedf tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:58.015726 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d5c0dc8c-99e0-4d28-b884-6ed22ccebedf tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:58.016517 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d5c0dc8c-99e0-4d28-b884-6ed22ccebedf tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:58.016959 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d5c0dc8c-99e0-4d28-b884-6ed22ccebedf tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:58.125372 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-d5c0dc8c-99e0-4d28-b884-6ed22ccebedf tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28186 microversion: 2.1 time: 0.122090 Aug 27 04:40:58.126024 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 554/1081] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:40:58 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28186 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:40:58.572569 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-61652a37-f2cd-42a9-b307-8a086032718a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:58.573565 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-61652a37-f2cd-42a9-b307-8a086032718a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:58.580337 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-61652a37-f2cd-42a9-b307-8a086032718a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:58.580804 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-61652a37-f2cd-42a9-b307-8a086032718a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:58.581612 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-61652a37-f2cd-42a9-b307-8a086032718a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:58.582054 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-61652a37-f2cd-42a9-b307-8a086032718a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:58.681119 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-61652a37-f2cd-42a9-b307-8a086032718a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28655 microversion: 2.20 time: 0.112332 Aug 27 04:40:58.681689 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 528/1082] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:40:58 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28655 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:40:59.137880 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-76bece0b-7095-4677-8270-0ef519356dff tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:59.138938 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-76bece0b-7095-4677-8270-0ef519356dff tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:59.146117 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-76bece0b-7095-4677-8270-0ef519356dff tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:59.146589 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-76bece0b-7095-4677-8270-0ef519356dff tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:59.147363 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-76bece0b-7095-4677-8270-0ef519356dff tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:59.147794 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-76bece0b-7095-4677-8270-0ef519356dff tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:59.242699 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-76bece0b-7095-4677-8270-0ef519356dff tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28186 microversion: 2.1 time: 0.108817 Aug 27 04:40:59.243658 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 555/1083] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:40:59 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28186 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:40:59.693951 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-e11aefbf-2285-4272-853f-9d20873bd499 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:40:59.694894 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-e11aefbf-2285-4272-853f-9d20873bd499 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:40:59.706370 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e11aefbf-2285-4272-853f-9d20873bd499 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:59.706827 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e11aefbf-2285-4272-853f-9d20873bd499 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:59.707604 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e11aefbf-2285-4272-853f-9d20873bd499 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:40:59.708347 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e11aefbf-2285-4272-853f-9d20873bd499 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:40:59.820174 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-e11aefbf-2285-4272-853f-9d20873bd499 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28655 microversion: 2.20 time: 0.130867 Aug 27 04:40:59.820800 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 529/1084] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:40:59 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28655 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:41:00.255132 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-d789c230-af37-4736-ad9b-a5decb326dc6 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:00.256174 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-d789c230-af37-4736-ad9b-a5decb326dc6 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:00.262598 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d789c230-af37-4736-ad9b-a5decb326dc6 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:00.263037 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d789c230-af37-4736-ad9b-a5decb326dc6 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:00.263788 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d789c230-af37-4736-ad9b-a5decb326dc6 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:00.264235 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d789c230-af37-4736-ad9b-a5decb326dc6 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:00.362268 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-d789c230-af37-4736-ad9b-a5decb326dc6 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28186 microversion: 2.1 time: 0.110959 Aug 27 04:41:00.363794 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 556/1085] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:41:00 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28186 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:41:00.832056 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-6b8abcd9-90da-45d5-afd2-f663e3125938 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:00.833705 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-6b8abcd9-90da-45d5-afd2-f663e3125938 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:00.840301 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6b8abcd9-90da-45d5-afd2-f663e3125938 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:00.840759 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6b8abcd9-90da-45d5-afd2-f663e3125938 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:00.841534 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6b8abcd9-90da-45d5-afd2-f663e3125938 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:00.841974 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6b8abcd9-90da-45d5-afd2-f663e3125938 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:00.944507 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-6b8abcd9-90da-45d5-afd2-f663e3125938 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28655 microversion: 2.20 time: 0.116379 Aug 27 04:41:00.945384 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 530/1086] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:41:00 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28655 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:41:01.374528 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-13cbcd2f-ec06-4e60-ba57-aae535e53b56 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:01.375560 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-13cbcd2f-ec06-4e60-ba57-aae535e53b56 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:01.382052 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-13cbcd2f-ec06-4e60-ba57-aae535e53b56 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:01.382502 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-13cbcd2f-ec06-4e60-ba57-aae535e53b56 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:01.383263 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-13cbcd2f-ec06-4e60-ba57-aae535e53b56 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:01.383700 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-13cbcd2f-ec06-4e60-ba57-aae535e53b56 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:01.512894 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-13cbcd2f-ec06-4e60-ba57-aae535e53b56 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28186 microversion: 2.1 time: 0.142276 Aug 27 04:41:01.513510 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 557/1087] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:41:01 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28186 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:41:01.956865 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-7d43623d-d8ca-48ba-afca-ed81757d4800 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:01.958378 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-7d43623d-d8ca-48ba-afca-ed81757d4800 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:01.964910 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7d43623d-d8ca-48ba-afca-ed81757d4800 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:01.965361 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7d43623d-d8ca-48ba-afca-ed81757d4800 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:01.966129 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7d43623d-d8ca-48ba-afca-ed81757d4800 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:01.966574 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7d43623d-d8ca-48ba-afca-ed81757d4800 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:02.053132 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-7d43623d-d8ca-48ba-afca-ed81757d4800 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28655 microversion: 2.20 time: 0.100304 Aug 27 04:41:02.053765 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 531/1088] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:41:01 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28655 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:41:02.524895 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-be2bcbc1-0f89-4bfd-9325-71cfc88d21a5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:02.525886 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-be2bcbc1-0f89-4bfd-9325-71cfc88d21a5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:02.532344 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-be2bcbc1-0f89-4bfd-9325-71cfc88d21a5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:02.532791 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-be2bcbc1-0f89-4bfd-9325-71cfc88d21a5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:02.533549 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-be2bcbc1-0f89-4bfd-9325-71cfc88d21a5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:02.533979 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-be2bcbc1-0f89-4bfd-9325-71cfc88d21a5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:02.631421 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-be2bcbc1-0f89-4bfd-9325-71cfc88d21a5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28186 microversion: 2.1 time: 0.110340 Aug 27 04:41:02.632347 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 558/1089] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:41:02 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28186 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:41:03.065239 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-e0f1582a-e79d-4f34-9587-f231c949af48 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:03.066231 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-e0f1582a-e79d-4f34-9587-f231c949af48 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:03.073009 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e0f1582a-e79d-4f34-9587-f231c949af48 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:03.073454 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e0f1582a-e79d-4f34-9587-f231c949af48 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:03.074217 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e0f1582a-e79d-4f34-9587-f231c949af48 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:03.074647 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e0f1582a-e79d-4f34-9587-f231c949af48 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:03.169264 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-e0f1582a-e79d-4f34-9587-f231c949af48 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28655 microversion: 2.20 time: 0.107892 Aug 27 04:41:03.170108 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 532/1090] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:41:03 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28655 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:41:03.643193 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-c69b551b-13ce-48a7-8998-02f1bf6fcf55 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:03.644131 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-c69b551b-13ce-48a7-8998-02f1bf6fcf55 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:03.651292 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c69b551b-13ce-48a7-8998-02f1bf6fcf55 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:03.651739 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c69b551b-13ce-48a7-8998-02f1bf6fcf55 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:03.652538 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c69b551b-13ce-48a7-8998-02f1bf6fcf55 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:03.652977 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c69b551b-13ce-48a7-8998-02f1bf6fcf55 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:03.745499 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-c69b551b-13ce-48a7-8998-02f1bf6fcf55 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28186 microversion: 2.1 time: 0.106306 Aug 27 04:41:03.746143 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 559/1091] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:41:03 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28186 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:41:04.182587 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-3674d8c0-5e05-4c48-ae4d-96fbdfc7962d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:04.183564 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-3674d8c0-5e05-4c48-ae4d-96fbdfc7962d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:04.189905 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3674d8c0-5e05-4c48-ae4d-96fbdfc7962d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:04.190347 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3674d8c0-5e05-4c48-ae4d-96fbdfc7962d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:04.191096 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3674d8c0-5e05-4c48-ae4d-96fbdfc7962d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:04.191523 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3674d8c0-5e05-4c48-ae4d-96fbdfc7962d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:04.277385 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-3674d8c0-5e05-4c48-ae4d-96fbdfc7962d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28655 microversion: 2.20 time: 0.098724 Aug 27 04:41:04.278275 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 533/1092] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:41:04 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28655 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:41:04.757613 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-674ba9c7-2991-4f73-9ae8-f4cbe38eff5c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:04.758599 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-674ba9c7-2991-4f73-9ae8-f4cbe38eff5c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:04.765022 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-674ba9c7-2991-4f73-9ae8-f4cbe38eff5c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:04.765462 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-674ba9c7-2991-4f73-9ae8-f4cbe38eff5c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:04.766210 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-674ba9c7-2991-4f73-9ae8-f4cbe38eff5c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:04.766641 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-674ba9c7-2991-4f73-9ae8-f4cbe38eff5c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:04.854100 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-674ba9c7-2991-4f73-9ae8-f4cbe38eff5c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28186 microversion: 2.1 time: 0.100316 Aug 27 04:41:04.854740 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 560/1093] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:41:04 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28186 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:41:05.289652 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-d7818aab-f1bc-47a8-b685-9880902c2528 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:05.290654 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-d7818aab-f1bc-47a8-b685-9880902c2528 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:05.297185 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d7818aab-f1bc-47a8-b685-9880902c2528 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:05.297641 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d7818aab-f1bc-47a8-b685-9880902c2528 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:05.298410 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d7818aab-f1bc-47a8-b685-9880902c2528 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:05.298853 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d7818aab-f1bc-47a8-b685-9880902c2528 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:05.381863 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-d7818aab-f1bc-47a8-b685-9880902c2528 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28655 microversion: 2.20 time: 0.095606 Aug 27 04:41:05.382557 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 534/1094] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:41:05 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28655 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:41:05.867759 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-9661ec90-abaa-4a70-bf4f-02f8cab6878e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:05.868920 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-9661ec90-abaa-4a70-bf4f-02f8cab6878e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:05.875584 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9661ec90-abaa-4a70-bf4f-02f8cab6878e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:05.876050 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9661ec90-abaa-4a70-bf4f-02f8cab6878e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:05.876824 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9661ec90-abaa-4a70-bf4f-02f8cab6878e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:05.877257 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9661ec90-abaa-4a70-bf4f-02f8cab6878e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:05.964216 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-9661ec90-abaa-4a70-bf4f-02f8cab6878e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28186 microversion: 2.1 time: 0.101431 Aug 27 04:41:05.964875 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 561/1095] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:41:05 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28186 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:41:06.394144 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-e61a0115-e390-49c4-a5f2-c0623d4d9250 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:06.395145 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-e61a0115-e390-49c4-a5f2-c0623d4d9250 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:06.402381 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e61a0115-e390-49c4-a5f2-c0623d4d9250 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:06.402837 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e61a0115-e390-49c4-a5f2-c0623d4d9250 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:06.403613 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e61a0115-e390-49c4-a5f2-c0623d4d9250 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:06.404087 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e61a0115-e390-49c4-a5f2-c0623d4d9250 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:06.501315 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-e61a0115-e390-49c4-a5f2-c0623d4d9250 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28655 microversion: 2.20 time: 0.111048 Aug 27 04:41:06.501969 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 535/1096] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:41:06 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28655 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:41:06.977608 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-0ae1ad33-cac8-493e-a9ca-cae5000d9373 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:06.978599 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-0ae1ad33-cac8-493e-a9ca-cae5000d9373 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:06.985332 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0ae1ad33-cac8-493e-a9ca-cae5000d9373 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:06.985778 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0ae1ad33-cac8-493e-a9ca-cae5000d9373 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:06.986537 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0ae1ad33-cac8-493e-a9ca-cae5000d9373 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:06.986969 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0ae1ad33-cac8-493e-a9ca-cae5000d9373 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:07.078160 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-0ae1ad33-cac8-493e-a9ca-cae5000d9373 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28186 microversion: 2.1 time: 0.104991 Aug 27 04:41:07.078822 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 562/1097] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:41:06 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28186 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:41:07.802335 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-65f7f956-1c35-49b5-8e0f-1ee3b3b93220 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:07.803417 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-65f7f956-1c35-49b5-8e0f-1ee3b3b93220 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:07.809545 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-65f7f956-1c35-49b5-8e0f-1ee3b3b93220 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:07.810000 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-65f7f956-1c35-49b5-8e0f-1ee3b3b93220 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:07.810763 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-65f7f956-1c35-49b5-8e0f-1ee3b3b93220 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:07.811261 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-65f7f956-1c35-49b5-8e0f-1ee3b3b93220 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:07.906591 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-65f7f956-1c35-49b5-8e0f-1ee3b3b93220 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28655 microversion: 2.20 time: 0.397202 Aug 27 04:41:07.907198 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 536/1098] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:41:07 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28655 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:41:08.090992 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-dcecfd21-b017-4383-bf5c-6b374a428dde tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:08.092008 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-dcecfd21-b017-4383-bf5c-6b374a428dde tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:08.098674 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-dcecfd21-b017-4383-bf5c-6b374a428dde tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:08.099125 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-dcecfd21-b017-4383-bf5c-6b374a428dde tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:08.099896 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-dcecfd21-b017-4383-bf5c-6b374a428dde tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:08.100356 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-dcecfd21-b017-4383-bf5c-6b374a428dde tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:08.197127 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-dcecfd21-b017-4383-bf5c-6b374a428dde tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28186 microversion: 2.1 time: 0.110037 Aug 27 04:41:08.197761 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 563/1099] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:41:08 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28186 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:41:08.918838 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-8b449a7d-c17e-41f0-bd98-aade8c3cf809 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:08.919918 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-8b449a7d-c17e-41f0-bd98-aade8c3cf809 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:08.926439 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-8b449a7d-c17e-41f0-bd98-aade8c3cf809 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:08.926888 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-8b449a7d-c17e-41f0-bd98-aade8c3cf809 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:08.927649 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-8b449a7d-c17e-41f0-bd98-aade8c3cf809 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:08.928122 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-8b449a7d-c17e-41f0-bd98-aade8c3cf809 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:09.036566 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-8b449a7d-c17e-41f0-bd98-aade8c3cf809 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28655 microversion: 2.20 time: 0.121587 Aug 27 04:41:09.037446 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 537/1100] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:41:08 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28655 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:41:09.209136 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-91883c7e-8b1d-4cdc-b771-f9c8ede498af tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:09.210053 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-91883c7e-8b1d-4cdc-b771-f9c8ede498af tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:09.216556 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-91883c7e-8b1d-4cdc-b771-f9c8ede498af tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:09.217005 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-91883c7e-8b1d-4cdc-b771-f9c8ede498af tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:09.217766 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-91883c7e-8b1d-4cdc-b771-f9c8ede498af tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:09.218203 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-91883c7e-8b1d-4cdc-b771-f9c8ede498af tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:09.316015 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-91883c7e-8b1d-4cdc-b771-f9c8ede498af tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28186 microversion: 2.1 time: 0.110867 Aug 27 04:41:09.316921 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 564/1101] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:41:09 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28186 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:41:10.048015 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-14bcbd47-4eab-42cc-80c2-d886dd3704d8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:10.049018 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-14bcbd47-4eab-42cc-80c2-d886dd3704d8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:10.055496 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-14bcbd47-4eab-42cc-80c2-d886dd3704d8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:10.055947 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-14bcbd47-4eab-42cc-80c2-d886dd3704d8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:10.056738 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-14bcbd47-4eab-42cc-80c2-d886dd3704d8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:10.057177 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-14bcbd47-4eab-42cc-80c2-d886dd3704d8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:10.159553 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-14bcbd47-4eab-42cc-80c2-d886dd3704d8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28655 microversion: 2.20 time: 0.115596 Aug 27 04:41:10.160207 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 538/1102] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:41:10 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28655 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:41:10.328660 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-398008aa-b509-4bd9-92e6-2c7fe3708c2b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:10.329654 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-398008aa-b509-4bd9-92e6-2c7fe3708c2b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:10.336832 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-398008aa-b509-4bd9-92e6-2c7fe3708c2b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:10.337282 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-398008aa-b509-4bd9-92e6-2c7fe3708c2b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:10.338044 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-398008aa-b509-4bd9-92e6-2c7fe3708c2b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:10.338479 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-398008aa-b509-4bd9-92e6-2c7fe3708c2b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:10.426891 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-398008aa-b509-4bd9-92e6-2c7fe3708c2b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28186 microversion: 2.1 time: 0.102221 Aug 27 04:41:10.427578 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 565/1103] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:41:10 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28186 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:41:11.172504 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-4f1159f2-5f82-4cfb-a778-8be13b426018 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:11.173574 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-4f1159f2-5f82-4cfb-a778-8be13b426018 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:11.180653 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4f1159f2-5f82-4cfb-a778-8be13b426018 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:11.181107 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4f1159f2-5f82-4cfb-a778-8be13b426018 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:11.181879 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4f1159f2-5f82-4cfb-a778-8be13b426018 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:11.182317 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4f1159f2-5f82-4cfb-a778-8be13b426018 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:11.283615 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-4f1159f2-5f82-4cfb-a778-8be13b426018 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 28929 microversion: 2.20 time: 0.115120 Aug 27 04:41:11.284274 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 539/1104] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:41:11 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 28929 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:41:11.439215 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-86324aa6-8474-4aa1-b0fc-8084e5284a12 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:11.440164 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-86324aa6-8474-4aa1-b0fc-8084e5284a12 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:11.446858 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-86324aa6-8474-4aa1-b0fc-8084e5284a12 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:11.447302 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-86324aa6-8474-4aa1-b0fc-8084e5284a12 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:11.448103 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-86324aa6-8474-4aa1-b0fc-8084e5284a12 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:11.448540 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-86324aa6-8474-4aa1-b0fc-8084e5284a12 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:11.540289 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-86324aa6-8474-4aa1-b0fc-8084e5284a12 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28186 microversion: 2.1 time: 0.104972 Aug 27 04:41:11.541264 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 566/1105] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:41:11 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28186 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:41:12.296622 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-cbfdf7c5-5a59-43cd-9bdd-c758d4a67eb3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:12.297626 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-cbfdf7c5-5a59-43cd-9bdd-c758d4a67eb3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:12.304115 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-cbfdf7c5-5a59-43cd-9bdd-c758d4a67eb3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:12.304569 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-cbfdf7c5-5a59-43cd-9bdd-c758d4a67eb3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:12.305333 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-cbfdf7c5-5a59-43cd-9bdd-c758d4a67eb3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:12.305772 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-cbfdf7c5-5a59-43cd-9bdd-c758d4a67eb3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:12.415748 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-cbfdf7c5-5a59-43cd-9bdd-c758d4a67eb3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 31051 microversion: 2.20 time: 0.123070 Aug 27 04:41:12.416422 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 540/1106] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:41:12 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 31051 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:41:12.552739 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-ad0f17b2-b866-4c6b-9251-bca7733dd14a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:12.553725 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-ad0f17b2-b866-4c6b-9251-bca7733dd14a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:12.560206 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ad0f17b2-b866-4c6b-9251-bca7733dd14a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:12.560655 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ad0f17b2-b866-4c6b-9251-bca7733dd14a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:12.561414 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ad0f17b2-b866-4c6b-9251-bca7733dd14a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:12.561845 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ad0f17b2-b866-4c6b-9251-bca7733dd14a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:12.664320 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-ad0f17b2-b866-4c6b-9251-bca7733dd14a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28186 microversion: 2.1 time: 0.115489 Aug 27 04:41:12.664984 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 567/1107] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:41:12 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28186 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:41:13.427209 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-c0627c6d-ddc6-446c-91ff-36b9b2647d12 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:13.428824 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-c0627c6d-ddc6-446c-91ff-36b9b2647d12 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:13.435313 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-c0627c6d-ddc6-446c-91ff-36b9b2647d12 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:13.435764 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-c0627c6d-ddc6-446c-91ff-36b9b2647d12 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:13.436554 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-c0627c6d-ddc6-446c-91ff-36b9b2647d12 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:13.436988 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-c0627c6d-ddc6-446c-91ff-36b9b2647d12 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:13.529869 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-c0627c6d-ddc6-446c-91ff-36b9b2647d12 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 32804 microversion: 2.20 time: 0.106593 Aug 27 04:41:13.530483 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 541/1108] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:41:13 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 32804 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:41:13.676329 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-5cacfc9a-967c-4cf5-8a81-00c0bd63dc42 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:13.677916 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-5cacfc9a-967c-4cf5-8a81-00c0bd63dc42 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:13.684363 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5cacfc9a-967c-4cf5-8a81-00c0bd63dc42 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:13.684817 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5cacfc9a-967c-4cf5-8a81-00c0bd63dc42 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:13.685577 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5cacfc9a-967c-4cf5-8a81-00c0bd63dc42 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:13.686014 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5cacfc9a-967c-4cf5-8a81-00c0bd63dc42 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:13.794173 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-5cacfc9a-967c-4cf5-8a81-00c0bd63dc42 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28476 microversion: 2.1 time: 0.121859 Aug 27 04:41:13.794835 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 568/1109] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:41:13 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28476 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:41:14.542861 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-d97c147d-bb45-4ca5-9d23-35b78fe0753a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:14.543844 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-d97c147d-bb45-4ca5-9d23-35b78fe0753a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:14.550395 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d97c147d-bb45-4ca5-9d23-35b78fe0753a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:14.550844 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d97c147d-bb45-4ca5-9d23-35b78fe0753a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:14.551603 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d97c147d-bb45-4ca5-9d23-35b78fe0753a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:14.552057 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d97c147d-bb45-4ca5-9d23-35b78fe0753a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:14.657379 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-d97c147d-bb45-4ca5-9d23-35b78fe0753a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 33748 microversion: 2.20 time: 0.118338 Aug 27 04:41:14.657924 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 542/1110] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:41:14 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 33748 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:41:14.805297 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-bcff928d-c0c1-46b5-a955-e6f3d199f97c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:14.806277 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-bcff928d-c0c1-46b5-a955-e6f3d199f97c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:14.812694 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-bcff928d-c0c1-46b5-a955-e6f3d199f97c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:14.813136 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-bcff928d-c0c1-46b5-a955-e6f3d199f97c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:14.813886 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-bcff928d-c0c1-46b5-a955-e6f3d199f97c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:14.814314 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-bcff928d-c0c1-46b5-a955-e6f3d199f97c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:14.911427 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-bcff928d-c0c1-46b5-a955-e6f3d199f97c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28494 microversion: 2.1 time: 0.109933 Aug 27 04:41:14.911975 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 569/1111] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:41:14 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28494 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:41:15.669536 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-aa04ed85-125d-46f6-acfa-0f493c13de5a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:15.670448 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-aa04ed85-125d-46f6-acfa-0f493c13de5a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:15.676899 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-aa04ed85-125d-46f6-acfa-0f493c13de5a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:15.677351 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-aa04ed85-125d-46f6-acfa-0f493c13de5a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:15.678113 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-aa04ed85-125d-46f6-acfa-0f493c13de5a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:15.678577 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-aa04ed85-125d-46f6-acfa-0f493c13de5a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:15.784494 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-aa04ed85-125d-46f6-acfa-0f493c13de5a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 35028 microversion: 2.20 time: 0.118995 Aug 27 04:41:15.785441 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 543/1112] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:41:15 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 35028 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:41:15.922582 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-ea9b0e2f-3b30-4933-834f-ee7ab43a4e30 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:15.923510 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-ea9b0e2f-3b30-4933-834f-ee7ab43a4e30 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:15.930489 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ea9b0e2f-3b30-4933-834f-ee7ab43a4e30 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:15.930939 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ea9b0e2f-3b30-4933-834f-ee7ab43a4e30 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:15.931705 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ea9b0e2f-3b30-4933-834f-ee7ab43a4e30 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:15.932176 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ea9b0e2f-3b30-4933-834f-ee7ab43a4e30 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:16.025875 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-ea9b0e2f-3b30-4933-834f-ee7ab43a4e30 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28644 microversion: 2.1 time: 0.107189 Aug 27 04:41:16.026518 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 570/1113] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:41:15 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28644 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:41:16.795842 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-9e1eb818-22f9-480b-bc20-e001764de4ac tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:16.796859 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-9e1eb818-22f9-480b-bc20-e001764de4ac tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:16.803738 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9e1eb818-22f9-480b-bc20-e001764de4ac tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:16.804213 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9e1eb818-22f9-480b-bc20-e001764de4ac tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:16.804971 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9e1eb818-22f9-480b-bc20-e001764de4ac tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:16.805401 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9e1eb818-22f9-480b-bc20-e001764de4ac tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:16.918009 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-9e1eb818-22f9-480b-bc20-e001764de4ac tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 36168 microversion: 2.20 time: 0.126029 Aug 27 04:41:16.918634 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 544/1114] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:41:16 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 36168 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:41:17.038403 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-91fb6cf9-929d-4b2a-b961-f211c1516a3c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:17.039394 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-91fb6cf9-929d-4b2a-b961-f211c1516a3c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:17.046022 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-91fb6cf9-929d-4b2a-b961-f211c1516a3c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:17.046413 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-91fb6cf9-929d-4b2a-b961-f211c1516a3c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:17.047177 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-91fb6cf9-929d-4b2a-b961-f211c1516a3c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:17.047622 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-91fb6cf9-929d-4b2a-b961-f211c1516a3c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:17.134171 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-91fb6cf9-929d-4b2a-b961-f211c1516a3c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28644 microversion: 2.1 time: 0.100167 Aug 27 04:41:17.134823 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 571/1115] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:41:17 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28644 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:41:17.931306 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-92346731-1d32-4fc2-b821-2d2068b2a122 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:17.932329 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-92346731-1d32-4fc2-b821-2d2068b2a122 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:17.938922 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-92346731-1d32-4fc2-b821-2d2068b2a122 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:17.939374 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-92346731-1d32-4fc2-b821-2d2068b2a122 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:17.940217 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-92346731-1d32-4fc2-b821-2d2068b2a122 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:17.940661 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-92346731-1d32-4fc2-b821-2d2068b2a122 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:18.051540 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-92346731-1d32-4fc2-b821-2d2068b2a122 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 37785 microversion: 2.20 time: 0.124094 Aug 27 04:41:18.052383 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 545/1116] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:41:17 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 37785 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:41:18.147454 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-3a6512d8-7eb6-4c7c-9636-2d109298102b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:18.148572 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-3a6512d8-7eb6-4c7c-9636-2d109298102b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:18.155514 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3a6512d8-7eb6-4c7c-9636-2d109298102b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:18.155961 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3a6512d8-7eb6-4c7c-9636-2d109298102b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:18.156761 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3a6512d8-7eb6-4c7c-9636-2d109298102b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:18.157195 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3a6512d8-7eb6-4c7c-9636-2d109298102b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:18.245151 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-3a6512d8-7eb6-4c7c-9636-2d109298102b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28644 microversion: 2.1 time: 0.102101 Aug 27 04:41:18.245723 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 572/1117] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:41:18 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28644 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:41:19.063906 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-de7cd683-efbe-4370-8f31-f0271db6975f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:19.065051 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-de7cd683-efbe-4370-8f31-f0271db6975f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:19.071619 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-de7cd683-efbe-4370-8f31-f0271db6975f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:19.072107 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-de7cd683-efbe-4370-8f31-f0271db6975f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:19.072878 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-de7cd683-efbe-4370-8f31-f0271db6975f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:19.073325 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-de7cd683-efbe-4370-8f31-f0271db6975f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:19.178265 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-de7cd683-efbe-4370-8f31-f0271db6975f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 38211 microversion: 2.20 time: 0.118601 Aug 27 04:41:19.178913 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 546/1118] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:41:19 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 38211 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:41:19.257526 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-ca1a4116-b047-4ae6-97f2-845e39004ba7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:19.258548 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-ca1a4116-b047-4ae6-97f2-845e39004ba7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:19.265041 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ca1a4116-b047-4ae6-97f2-845e39004ba7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:19.265489 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ca1a4116-b047-4ae6-97f2-845e39004ba7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:19.266250 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ca1a4116-b047-4ae6-97f2-845e39004ba7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:19.266686 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ca1a4116-b047-4ae6-97f2-845e39004ba7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:19.357183 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-ca1a4116-b047-4ae6-97f2-845e39004ba7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28644 microversion: 2.1 time: 0.103533 Aug 27 04:41:19.357995 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 573/1119] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:41:19 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28644 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:41:20.190792 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-5cc4d5db-f317-48c3-9a73-ebd020d74e78 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:20.191776 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-5cc4d5db-f317-48c3-9a73-ebd020d74e78 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:20.198887 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5cc4d5db-f317-48c3-9a73-ebd020d74e78 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:20.199333 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5cc4d5db-f317-48c3-9a73-ebd020d74e78 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:20.200117 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5cc4d5db-f317-48c3-9a73-ebd020d74e78 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:20.200547 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5cc4d5db-f317-48c3-9a73-ebd020d74e78 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:20.287434 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-5cc4d5db-f317-48c3-9a73-ebd020d74e78 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 38211 microversion: 2.20 time: 0.100502 Aug 27 04:41:20.288127 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 547/1120] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:41:20 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 38211 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:41:20.369192 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-43cbd477-4db7-40f9-85eb-f3a4ba2ace4b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:20.370192 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-43cbd477-4db7-40f9-85eb-f3a4ba2ace4b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:20.376802 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-43cbd477-4db7-40f9-85eb-f3a4ba2ace4b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:20.377256 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-43cbd477-4db7-40f9-85eb-f3a4ba2ace4b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:20.378026 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-43cbd477-4db7-40f9-85eb-f3a4ba2ace4b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:20.378463 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-43cbd477-4db7-40f9-85eb-f3a4ba2ace4b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:20.466367 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-43cbd477-4db7-40f9-85eb-f3a4ba2ace4b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28644 microversion: 2.1 time: 0.101028 Aug 27 04:41:20.466993 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 574/1121] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:41:20 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28644 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:41:21.299905 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-54dde63d-87fb-4767-9eae-25d03eb56b37 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:21.300918 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-54dde63d-87fb-4767-9eae-25d03eb56b37 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:21.307249 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-54dde63d-87fb-4767-9eae-25d03eb56b37 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:21.307694 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-54dde63d-87fb-4767-9eae-25d03eb56b37 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:21.308489 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-54dde63d-87fb-4767-9eae-25d03eb56b37 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:21.308909 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-54dde63d-87fb-4767-9eae-25d03eb56b37 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:21.395454 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-54dde63d-87fb-4767-9eae-25d03eb56b37 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 38211 microversion: 2.20 time: 0.099419 Aug 27 04:41:21.396610 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 548/1122] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:41:21 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 38211 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:41:21.478993 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-5284376f-1871-4b31-b430-5cc8b3c2190d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:21.480265 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-5284376f-1871-4b31-b430-5cc8b3c2190d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:21.486653 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5284376f-1871-4b31-b430-5cc8b3c2190d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:21.487085 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5284376f-1871-4b31-b430-5cc8b3c2190d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:21.487835 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5284376f-1871-4b31-b430-5cc8b3c2190d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:21.488293 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5284376f-1871-4b31-b430-5cc8b3c2190d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:21.578419 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-5284376f-1871-4b31-b430-5cc8b3c2190d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28644 microversion: 2.1 time: 0.103805 Aug 27 04:41:21.579009 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 575/1123] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:41:21 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28644 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:41:22.409384 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-4172306c-61b8-4d04-b164-fa393eb7a6ff tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:22.410375 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-4172306c-61b8-4d04-b164-fa393eb7a6ff tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:22.417287 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4172306c-61b8-4d04-b164-fa393eb7a6ff tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:22.417734 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4172306c-61b8-4d04-b164-fa393eb7a6ff tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:22.418493 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4172306c-61b8-4d04-b164-fa393eb7a6ff tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:22.418924 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4172306c-61b8-4d04-b164-fa393eb7a6ff tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:22.510022 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-4172306c-61b8-4d04-b164-fa393eb7a6ff tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 38211 microversion: 2.20 time: 0.104978 Aug 27 04:41:22.510667 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 549/1124] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:41:22 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 38211 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:41:22.590356 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-e3d7cb6e-92ed-499b-8b71-8f56bd37f770 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:22.591337 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-e3d7cb6e-92ed-499b-8b71-8f56bd37f770 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:22.597945 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e3d7cb6e-92ed-499b-8b71-8f56bd37f770 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:22.598385 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e3d7cb6e-92ed-499b-8b71-8f56bd37f770 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:22.599136 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e3d7cb6e-92ed-499b-8b71-8f56bd37f770 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:22.600118 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e3d7cb6e-92ed-499b-8b71-8f56bd37f770 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:22.684173 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-e3d7cb6e-92ed-499b-8b71-8f56bd37f770 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28644 microversion: 2.1 time: 0.097523 Aug 27 04:41:22.684738 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 576/1125] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:41:22 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28644 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:41:23.522762 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-63fbb18f-1f82-4b0e-9438-a30df80d4e3f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:23.523786 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-63fbb18f-1f82-4b0e-9438-a30df80d4e3f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:23.530302 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-63fbb18f-1f82-4b0e-9438-a30df80d4e3f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:23.530757 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-63fbb18f-1f82-4b0e-9438-a30df80d4e3f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:23.531528 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-63fbb18f-1f82-4b0e-9438-a30df80d4e3f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:23.531979 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-63fbb18f-1f82-4b0e-9438-a30df80d4e3f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:23.625334 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-63fbb18f-1f82-4b0e-9438-a30df80d4e3f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 200 len: 38354 microversion: 2.20 time: 0.106529 Aug 27 04:41:23.625920 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 550/1126] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:41:23 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 38354 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:41:23.636846 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-e0467e4d-40ec-48c6-821d-85c09d95fae9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:23.637429 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-e0467e4d-40ec-48c6-821d-85c09d95fae9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:23.643933 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e0467e4d-40ec-48c6-821d-85c09d95fae9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:23.644415 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e0467e4d-40ec-48c6-821d-85c09d95fae9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:23.645181 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e0467e4d-40ec-48c6-821d-85c09d95fae9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:23.645618 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e0467e4d-40ec-48c6-821d-85c09d95fae9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:23.668079 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-e0467e4d-40ec-48c6-821d-85c09d95fae9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/ips" status: 200 len: 152 microversion: 2.20 time: 0.035222 Aug 27 04:41:23.668655 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 577/1127] 10.222.0.53 () {60 vars in 1289 bytes} [Fri Aug 27 04:41:23 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/ips => generated 152 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:41:23.696648 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-85a49f21-43e0-404c-b8a4-263070f788b2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:23.697635 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-85a49f21-43e0-404c-b8a4-263070f788b2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:23.704127 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-85a49f21-43e0-404c-b8a4-263070f788b2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:23.704489 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-85a49f21-43e0-404c-b8a4-263070f788b2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:23.705254 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-85a49f21-43e0-404c-b8a4-263070f788b2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:23.705699 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-85a49f21-43e0-404c-b8a4-263070f788b2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:23.790450 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-85a49f21-43e0-404c-b8a4-263070f788b2 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28644 microversion: 2.1 time: 0.098316 Aug 27 04:41:23.793166 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 551/1128] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:41:23 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28644 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:41:24.802314 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-d7453fe2-cf56-4088-8f00-692e495a6bfd tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:24.803223 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-d7453fe2-cf56-4088-8f00-692e495a6bfd tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:24.809507 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d7453fe2-cf56-4088-8f00-692e495a6bfd tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:24.809954 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d7453fe2-cf56-4088-8f00-692e495a6bfd tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:24.810717 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d7453fe2-cf56-4088-8f00-692e495a6bfd tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:24.811152 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d7453fe2-cf56-4088-8f00-692e495a6bfd tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:24.900599 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-d7453fe2-cf56-4088-8f00-692e495a6bfd tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28644 microversion: 2.1 time: 0.101812 Aug 27 04:41:24.901217 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 578/1129] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:41:24 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28644 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:41:25.913311 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-30ac6f88-11ae-47ac-8492-e3d8239ff171 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:25.914303 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-30ac6f88-11ae-47ac-8492-e3d8239ff171 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:25.920768 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-30ac6f88-11ae-47ac-8492-e3d8239ff171 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:25.921215 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-30ac6f88-11ae-47ac-8492-e3d8239ff171 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:25.921974 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-30ac6f88-11ae-47ac-8492-e3d8239ff171 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:25.922408 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-30ac6f88-11ae-47ac-8492-e3d8239ff171 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:26.009230 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-30ac6f88-11ae-47ac-8492-e3d8239ff171 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28644 microversion: 2.1 time: 0.100397 Aug 27 04:41:26.009887 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 552/1130] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:41:25 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28644 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:41:27.021100 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-452ead45-38f6-4bb6-8f98-1ed16d27d86c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:27.022098 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-452ead45-38f6-4bb6-8f98-1ed16d27d86c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:27.028748 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-452ead45-38f6-4bb6-8f98-1ed16d27d86c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:27.029197 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-452ead45-38f6-4bb6-8f98-1ed16d27d86c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:27.030012 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-452ead45-38f6-4bb6-8f98-1ed16d27d86c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:27.030435 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-452ead45-38f6-4bb6-8f98-1ed16d27d86c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:27.129801 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-452ead45-38f6-4bb6-8f98-1ed16d27d86c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28644 microversion: 2.1 time: 0.112515 Aug 27 04:41:27.130472 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 579/1131] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:41:27 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28644 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:41:28.142076 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-035f1d87-16f3-4cdf-ac64-002f15efc1f7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:28.143068 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-035f1d87-16f3-4cdf-ac64-002f15efc1f7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:28.149570 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-035f1d87-16f3-4cdf-ac64-002f15efc1f7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:28.150023 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-035f1d87-16f3-4cdf-ac64-002f15efc1f7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:28.150785 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-035f1d87-16f3-4cdf-ac64-002f15efc1f7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:28.151219 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-035f1d87-16f3-4cdf-ac64-002f15efc1f7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:28.234702 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-035f1d87-16f3-4cdf-ac64-002f15efc1f7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28644 microversion: 2.1 time: 0.096458 Aug 27 04:41:28.235288 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 553/1132] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:41:28 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28644 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:41:29.246379 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-5e3ad718-8dfe-4d0f-8879-a509698ba572 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:29.247389 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-5e3ad718-8dfe-4d0f-8879-a509698ba572 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:29.253867 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5e3ad718-8dfe-4d0f-8879-a509698ba572 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:29.254307 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5e3ad718-8dfe-4d0f-8879-a509698ba572 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:29.255058 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5e3ad718-8dfe-4d0f-8879-a509698ba572 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:29.255484 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5e3ad718-8dfe-4d0f-8879-a509698ba572 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:29.339810 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-5e3ad718-8dfe-4d0f-8879-a509698ba572 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28644 microversion: 2.1 time: 0.097183 Aug 27 04:41:29.340407 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 580/1133] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:41:29 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28644 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:41:30.352009 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-f6e18f77-8199-43f7-8a0d-c5108113af8e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:30.353049 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-f6e18f77-8199-43f7-8a0d-c5108113af8e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:30.359894 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f6e18f77-8199-43f7-8a0d-c5108113af8e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:30.360562 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f6e18f77-8199-43f7-8a0d-c5108113af8e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:30.361369 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f6e18f77-8199-43f7-8a0d-c5108113af8e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:30.361814 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f6e18f77-8199-43f7-8a0d-c5108113af8e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:30.444123 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-f6e18f77-8199-43f7-8a0d-c5108113af8e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28644 microversion: 2.1 time: 0.096464 Aug 27 04:41:30.444769 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 554/1134] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:41:30 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28644 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:41:31.456106 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-b66f0263-9ba0-49a7-9ec2-7401779b5926 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:31.457093 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-b66f0263-9ba0-49a7-9ec2-7401779b5926 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:31.463692 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b66f0263-9ba0-49a7-9ec2-7401779b5926 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:31.464241 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b66f0263-9ba0-49a7-9ec2-7401779b5926 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:31.465007 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b66f0263-9ba0-49a7-9ec2-7401779b5926 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:31.465435 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b66f0263-9ba0-49a7-9ec2-7401779b5926 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:31.549078 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-b66f0263-9ba0-49a7-9ec2-7401779b5926 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28644 microversion: 2.1 time: 0.096885 Aug 27 04:41:31.549702 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 581/1135] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:41:31 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28644 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:41:32.561119 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-b617adea-1c3e-4a93-b732-3420e227a73d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:32.562107 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-b617adea-1c3e-4a93-b732-3420e227a73d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:32.569256 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b617adea-1c3e-4a93-b732-3420e227a73d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:32.569730 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b617adea-1c3e-4a93-b732-3420e227a73d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:32.570488 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b617adea-1c3e-4a93-b732-3420e227a73d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:32.570927 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b617adea-1c3e-4a93-b732-3420e227a73d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:32.659587 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-b617adea-1c3e-4a93-b732-3420e227a73d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28644 microversion: 2.1 time: 0.102317 Aug 27 04:41:32.660409 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 555/1136] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:41:32 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28644 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:41:33.671649 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-82f97ece-f705-4469-9b73-cea3997a5f42 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:33.672589 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-82f97ece-f705-4469-9b73-cea3997a5f42 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:33.679130 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-82f97ece-f705-4469-9b73-cea3997a5f42 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:33.679582 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-82f97ece-f705-4469-9b73-cea3997a5f42 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:33.680400 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-82f97ece-f705-4469-9b73-cea3997a5f42 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:33.680836 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-82f97ece-f705-4469-9b73-cea3997a5f42 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:33.768940 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-82f97ece-f705-4469-9b73-cea3997a5f42 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28644 microversion: 2.1 time: 0.101328 Aug 27 04:41:33.769554 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 582/1137] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:41:33 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28644 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:41:34.781616 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-b2294d07-d83c-43f8-b2b7-f088ac938c02 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:34.782596 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-b2294d07-d83c-43f8-b2b7-f088ac938c02 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:34.789601 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b2294d07-d83c-43f8-b2b7-f088ac938c02 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:34.790071 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b2294d07-d83c-43f8-b2b7-f088ac938c02 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:34.790829 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b2294d07-d83c-43f8-b2b7-f088ac938c02 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:34.791256 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b2294d07-d83c-43f8-b2b7-f088ac938c02 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:34.878090 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-b2294d07-d83c-43f8-b2b7-f088ac938c02 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28644 microversion: 2.1 time: 0.100301 Aug 27 04:41:34.878736 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 556/1138] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:41:34 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28644 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:41:35.890414 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-56072a22-0783-4e7e-92ea-3af9e7e53bc0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:35.891394 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-56072a22-0783-4e7e-92ea-3af9e7e53bc0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:35.898011 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-56072a22-0783-4e7e-92ea-3af9e7e53bc0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:35.898449 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-56072a22-0783-4e7e-92ea-3af9e7e53bc0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:35.899207 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-56072a22-0783-4e7e-92ea-3af9e7e53bc0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:35.899634 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-56072a22-0783-4e7e-92ea-3af9e7e53bc0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:35.996186 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-56072a22-0783-4e7e-92ea-3af9e7e53bc0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28644 microversion: 2.1 time: 0.109566 Aug 27 04:41:35.996871 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 583/1139] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:41:35 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28644 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:41:37.008821 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-36bcf48a-a7f1-47b1-b651-98b9db74b220 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:37.009822 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-36bcf48a-a7f1-47b1-b651-98b9db74b220 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:37.016413 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-36bcf48a-a7f1-47b1-b651-98b9db74b220 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:37.016868 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-36bcf48a-a7f1-47b1-b651-98b9db74b220 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:37.017639 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-36bcf48a-a7f1-47b1-b651-98b9db74b220 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:37.018081 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-36bcf48a-a7f1-47b1-b651-98b9db74b220 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:37.131355 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-36bcf48a-a7f1-47b1-b651-98b9db74b220 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28644 microversion: 2.1 time: 0.127076 Aug 27 04:41:37.132722 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 557/1140] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:41:37 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28644 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:41:38.144827 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-28bb6fc9-8a32-4ca6-ab49-102bfde47e6d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:38.145825 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-28bb6fc9-8a32-4ca6-ab49-102bfde47e6d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:38.153087 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-28bb6fc9-8a32-4ca6-ab49-102bfde47e6d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:38.153538 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-28bb6fc9-8a32-4ca6-ab49-102bfde47e6d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:38.154312 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-28bb6fc9-8a32-4ca6-ab49-102bfde47e6d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:38.154749 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-28bb6fc9-8a32-4ca6-ab49-102bfde47e6d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:38.304914 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-28bb6fc9-8a32-4ca6-ab49-102bfde47e6d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28644 microversion: 2.1 time: 0.164019 Aug 27 04:41:38.306152 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 584/1141] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:41:38 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28644 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:41:39.316538 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-3c5f2123-de8f-4a96-b30f-6f3336efb299 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:39.317549 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-3c5f2123-de8f-4a96-b30f-6f3336efb299 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:39.324022 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3c5f2123-de8f-4a96-b30f-6f3336efb299 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:39.324471 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3c5f2123-de8f-4a96-b30f-6f3336efb299 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:39.325228 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3c5f2123-de8f-4a96-b30f-6f3336efb299 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:39.325656 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3c5f2123-de8f-4a96-b30f-6f3336efb299 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:39.417880 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-3c5f2123-de8f-4a96-b30f-6f3336efb299 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28644 microversion: 2.1 time: 0.105195 Aug 27 04:41:39.418650 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 558/1142] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:41:39 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28644 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:41:40.430541 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-74fb1f91-fd00-466c-a8f7-980bdee848bc tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:40.431537 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-74fb1f91-fd00-466c-a8f7-980bdee848bc tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:40.438189 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-74fb1f91-fd00-466c-a8f7-980bdee848bc tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:40.438637 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-74fb1f91-fd00-466c-a8f7-980bdee848bc tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:40.439407 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-74fb1f91-fd00-466c-a8f7-980bdee848bc tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:40.439842 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-74fb1f91-fd00-466c-a8f7-980bdee848bc tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:40.527136 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-74fb1f91-fd00-466c-a8f7-980bdee848bc tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28644 microversion: 2.1 time: 0.101172 Aug 27 04:41:40.527756 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 585/1143] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:41:40 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28644 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:41:41.336007 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-72c3ae07-1246-4538-8494-da20388f2c91 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:41.336647 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-72c3ae07-1246-4538-8494-da20388f2c91 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:41.343086 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-72c3ae07-1246-4538-8494-da20388f2c91 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:41.343524 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-72c3ae07-1246-4538-8494-da20388f2c91 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:41.344313 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-72c3ae07-1246-4538-8494-da20388f2c91 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:41.344746 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-72c3ae07-1246-4538-8494-da20388f2c91 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:41.367570 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.objects.instance [None req-72c3ae07-1246-4538-8494-da20388f2c91 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lazy-loading 'flavor' on Instance uuid 4bbb8317-81d9-4e49-bd0b-32a4446ec505 {{(pid=108970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:41:41.539431 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-49ec8546-57b4-4455-9358-f42f13ed0559 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:41.540492 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-49ec8546-57b4-4455-9358-f42f13ed0559 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:41.547004 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-49ec8546-57b4-4455-9358-f42f13ed0559 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:41.547451 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-49ec8546-57b4-4455-9358-f42f13ed0559 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:41.548244 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-49ec8546-57b4-4455-9358-f42f13ed0559 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:41.548687 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-49ec8546-57b4-4455-9358-f42f13ed0559 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:41.657493 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-49ec8546-57b4-4455-9358-f42f13ed0559 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28644 microversion: 2.1 time: 0.122182 Aug 27 04:41:41.658333 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 586/1144] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:41:41 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28644 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:41:41.710278 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-72c3ae07-1246-4538-8494-da20388f2c91 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 202 len: 0 microversion: 2.20 time: 0.378778 Aug 27 04:41:41.710979 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 559/1145] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:41:41 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:41:41.719505 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-f0728bba-f8af-4ffa-8f9b-cc6904723a9e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:41.720233 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-f0728bba-f8af-4ffa-8f9b-cc6904723a9e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:41.728408 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f0728bba-f8af-4ffa-8f9b-cc6904723a9e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:41.728863 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f0728bba-f8af-4ffa-8f9b-cc6904723a9e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:41.729910 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f0728bba-f8af-4ffa-8f9b-cc6904723a9e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:41.731179 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f0728bba-f8af-4ffa-8f9b-cc6904723a9e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:41.951731 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-f0728bba-f8af-4ffa-8f9b-cc6904723a9e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:41.959632 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-f0728bba-f8af-4ffa-8f9b-cc6904723a9e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:41.961188 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-f0728bba-f8af-4ffa-8f9b-cc6904723a9e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:41.962414 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-f0728bba-f8af-4ffa-8f9b-cc6904723a9e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1725 microversion: 2.20 time: 0.246992 Aug 27 04:41:41.962980 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 587/1146] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:41:41 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1725 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:41:42.670552 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-4e981c4e-1f25-4561-a95e-8f88625e35e1 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:42.671446 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-4e981c4e-1f25-4561-a95e-8f88625e35e1 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:42.677751 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4e981c4e-1f25-4561-a95e-8f88625e35e1 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:42.678194 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4e981c4e-1f25-4561-a95e-8f88625e35e1 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:42.678983 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4e981c4e-1f25-4561-a95e-8f88625e35e1 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:42.679412 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4e981c4e-1f25-4561-a95e-8f88625e35e1 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:42.789018 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-4e981c4e-1f25-4561-a95e-8f88625e35e1 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28644 microversion: 2.1 time: 0.122815 Aug 27 04:41:42.789976 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 560/1147] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:41:42 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28644 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:41:42.981177 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-1e97cecb-8fbc-49b0-a628-b4d1428cc514 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:42.981696 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-1e97cecb-8fbc-49b0-a628-b4d1428cc514 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:42.988075 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1e97cecb-8fbc-49b0-a628-b4d1428cc514 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:42.988533 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1e97cecb-8fbc-49b0-a628-b4d1428cc514 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:42.989293 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1e97cecb-8fbc-49b0-a628-b4d1428cc514 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:42.989730 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1e97cecb-8fbc-49b0-a628-b4d1428cc514 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:43.109342 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-1e97cecb-8fbc-49b0-a628-b4d1428cc514 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:43.117573 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-1e97cecb-8fbc-49b0-a628-b4d1428cc514 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:43.119074 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-1e97cecb-8fbc-49b0-a628-b4d1428cc514 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:43.120232 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-1e97cecb-8fbc-49b0-a628-b4d1428cc514 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1725 microversion: 2.20 time: 0.143114 Aug 27 04:41:43.120795 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 588/1148] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:41:42 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1725 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:41:43.802491 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-92dfe550-c88e-4243-a736-eda6fbe4bb4b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:43.803485 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-92dfe550-c88e-4243-a736-eda6fbe4bb4b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:43.810029 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-92dfe550-c88e-4243-a736-eda6fbe4bb4b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:43.810483 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-92dfe550-c88e-4243-a736-eda6fbe4bb4b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:43.811281 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-92dfe550-c88e-4243-a736-eda6fbe4bb4b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:43.811722 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-92dfe550-c88e-4243-a736-eda6fbe4bb4b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:43.906779 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-92dfe550-c88e-4243-a736-eda6fbe4bb4b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28644 microversion: 2.1 time: 0.108156 Aug 27 04:41:43.907439 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 561/1149] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:41:43 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28644 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:41:44.138409 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-482fa46e-6004-4b9c-8853-68b64b3a7a9b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:44.139115 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-482fa46e-6004-4b9c-8853-68b64b3a7a9b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:44.145820 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-482fa46e-6004-4b9c-8853-68b64b3a7a9b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:44.146254 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-482fa46e-6004-4b9c-8853-68b64b3a7a9b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:44.147818 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-482fa46e-6004-4b9c-8853-68b64b3a7a9b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:44.148274 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-482fa46e-6004-4b9c-8853-68b64b3a7a9b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:44.277360 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-482fa46e-6004-4b9c-8853-68b64b3a7a9b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:44.285389 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-482fa46e-6004-4b9c-8853-68b64b3a7a9b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:44.286884 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-482fa46e-6004-4b9c-8853-68b64b3a7a9b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:44.288076 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-482fa46e-6004-4b9c-8853-68b64b3a7a9b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1725 microversion: 2.20 time: 0.153541 Aug 27 04:41:44.288639 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 589/1150] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:41:44 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:41:44.919450 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-36342341-55f5-49d4-a7a5-64d0ce8b60cc tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:44.920472 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-36342341-55f5-49d4-a7a5-64d0ce8b60cc tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:44.926899 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-36342341-55f5-49d4-a7a5-64d0ce8b60cc tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:44.927344 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-36342341-55f5-49d4-a7a5-64d0ce8b60cc tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:44.928739 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-36342341-55f5-49d4-a7a5-64d0ce8b60cc tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:44.929168 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-36342341-55f5-49d4-a7a5-64d0ce8b60cc tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:45.038433 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-36342341-55f5-49d4-a7a5-64d0ce8b60cc tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28644 microversion: 2.1 time: 0.122421 Aug 27 04:41:45.039027 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 562/1151] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:41:44 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28644 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:41:45.305940 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-db8d1bab-6447-44eb-b45d-c936d8d6821b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:45.306538 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-db8d1bab-6447-44eb-b45d-c936d8d6821b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:45.312826 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-db8d1bab-6447-44eb-b45d-c936d8d6821b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:45.313265 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-db8d1bab-6447-44eb-b45d-c936d8d6821b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:45.314022 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-db8d1bab-6447-44eb-b45d-c936d8d6821b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:45.314446 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-db8d1bab-6447-44eb-b45d-c936d8d6821b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:45.434563 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-db8d1bab-6447-44eb-b45d-c936d8d6821b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:45.442218 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-db8d1bab-6447-44eb-b45d-c936d8d6821b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:45.443693 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-db8d1bab-6447-44eb-b45d-c936d8d6821b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:45.444845 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-db8d1bab-6447-44eb-b45d-c936d8d6821b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1725 microversion: 2.20 time: 0.142680 Aug 27 04:41:45.445396 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 590/1152] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:41:45 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1725 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:41:46.050457 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-34bda537-8578-4316-b17e-0ff075847e50 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:46.051458 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-34bda537-8578-4316-b17e-0ff075847e50 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:46.058488 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-34bda537-8578-4316-b17e-0ff075847e50 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:46.058944 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-34bda537-8578-4316-b17e-0ff075847e50 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:46.059710 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-34bda537-8578-4316-b17e-0ff075847e50 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:46.060185 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-34bda537-8578-4316-b17e-0ff075847e50 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:46.151656 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-34bda537-8578-4316-b17e-0ff075847e50 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28644 microversion: 2.1 time: 0.105115 Aug 27 04:41:46.152588 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 563/1153] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:41:46 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28644 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:41:46.462358 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-cf87bf73-bef2-463b-8032-b9ac7b181991 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:46.462972 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-cf87bf73-bef2-463b-8032-b9ac7b181991 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:46.468956 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cf87bf73-bef2-463b-8032-b9ac7b181991 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:46.469406 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cf87bf73-bef2-463b-8032-b9ac7b181991 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:46.470171 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cf87bf73-bef2-463b-8032-b9ac7b181991 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:46.470608 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cf87bf73-bef2-463b-8032-b9ac7b181991 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:46.588354 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-cf87bf73-bef2-463b-8032-b9ac7b181991 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:46.596608 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-cf87bf73-bef2-463b-8032-b9ac7b181991 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:46.598916 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-cf87bf73-bef2-463b-8032-b9ac7b181991 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:46.600617 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-cf87bf73-bef2-463b-8032-b9ac7b181991 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1725 microversion: 2.20 time: 0.141362 Aug 27 04:41:46.601178 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 591/1154] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:41:46 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1725 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:41:47.163742 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-afbb8bd4-4be4-41c6-b822-98ebbe46e0de tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:47.164765 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-afbb8bd4-4be4-41c6-b822-98ebbe46e0de tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:47.171308 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-afbb8bd4-4be4-41c6-b822-98ebbe46e0de tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:47.171872 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-afbb8bd4-4be4-41c6-b822-98ebbe46e0de tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:47.172864 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-afbb8bd4-4be4-41c6-b822-98ebbe46e0de tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:47.173282 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-afbb8bd4-4be4-41c6-b822-98ebbe46e0de tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:47.258628 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-afbb8bd4-4be4-41c6-b822-98ebbe46e0de tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28644 microversion: 2.1 time: 0.098733 Aug 27 04:41:47.259292 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 564/1155] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:41:47 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28644 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:41:47.618664 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-dd87db54-9acb-448d-b9c0-fea355e9dc95 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:47.619275 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-dd87db54-9acb-448d-b9c0-fea355e9dc95 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:47.625269 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-dd87db54-9acb-448d-b9c0-fea355e9dc95 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:47.625714 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-dd87db54-9acb-448d-b9c0-fea355e9dc95 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:47.626508 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-dd87db54-9acb-448d-b9c0-fea355e9dc95 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:47.626943 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-dd87db54-9acb-448d-b9c0-fea355e9dc95 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:47.746370 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-dd87db54-9acb-448d-b9c0-fea355e9dc95 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:47.754050 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-dd87db54-9acb-448d-b9c0-fea355e9dc95 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:47.755527 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-dd87db54-9acb-448d-b9c0-fea355e9dc95 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:47.756725 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-dd87db54-9acb-448d-b9c0-fea355e9dc95 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1725 microversion: 2.20 time: 0.142300 Aug 27 04:41:47.757285 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 592/1156] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:41:47 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1725 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:41:48.271002 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-b591d04b-df73-45e6-ad94-2c89b06001fe tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:48.272561 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-b591d04b-df73-45e6-ad94-2c89b06001fe tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:48.279108 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b591d04b-df73-45e6-ad94-2c89b06001fe tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:48.279560 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b591d04b-df73-45e6-ad94-2c89b06001fe tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:48.280366 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b591d04b-df73-45e6-ad94-2c89b06001fe tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:48.280807 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b591d04b-df73-45e6-ad94-2c89b06001fe tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:48.370800 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-b591d04b-df73-45e6-ad94-2c89b06001fe tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28644 microversion: 2.1 time: 0.103689 Aug 27 04:41:48.372539 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 565/1157] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:41:48 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28644 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:41:48.775167 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-a1753695-9ee9-4feb-af80-20554e745f56 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:48.775778 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-a1753695-9ee9-4feb-af80-20554e745f56 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:48.781768 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a1753695-9ee9-4feb-af80-20554e745f56 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:48.782213 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a1753695-9ee9-4feb-af80-20554e745f56 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:48.782977 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a1753695-9ee9-4feb-af80-20554e745f56 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:48.783410 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a1753695-9ee9-4feb-af80-20554e745f56 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:48.911466 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-a1753695-9ee9-4feb-af80-20554e745f56 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:48.919929 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-a1753695-9ee9-4feb-af80-20554e745f56 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:48.921438 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-a1753695-9ee9-4feb-af80-20554e745f56 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:48.922567 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-a1753695-9ee9-4feb-af80-20554e745f56 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1725 microversion: 2.20 time: 0.151773 Aug 27 04:41:48.923129 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 593/1158] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:41:48 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:41:49.384020 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-d4acefe0-d9f1-4a29-9688-c57642511530 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:49.385092 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-d4acefe0-d9f1-4a29-9688-c57642511530 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:49.391717 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d4acefe0-d9f1-4a29-9688-c57642511530 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:49.392209 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d4acefe0-d9f1-4a29-9688-c57642511530 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:49.392994 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d4acefe0-d9f1-4a29-9688-c57642511530 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:49.393437 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d4acefe0-d9f1-4a29-9688-c57642511530 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:49.497885 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-d4acefe0-d9f1-4a29-9688-c57642511530 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28644 microversion: 2.1 time: 0.118296 Aug 27 04:41:49.498774 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 566/1159] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:41:49 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28644 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:41:49.940505 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-ba914e7b-de1f-418e-9482-cc9168e7e0b4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:49.941110 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-ba914e7b-de1f-418e-9482-cc9168e7e0b4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:49.947960 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ba914e7b-de1f-418e-9482-cc9168e7e0b4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:49.948432 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ba914e7b-de1f-418e-9482-cc9168e7e0b4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:49.949188 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ba914e7b-de1f-418e-9482-cc9168e7e0b4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:49.949616 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ba914e7b-de1f-418e-9482-cc9168e7e0b4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:50.066875 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-ba914e7b-de1f-418e-9482-cc9168e7e0b4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:50.074797 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-ba914e7b-de1f-418e-9482-cc9168e7e0b4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:50.076313 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-ba914e7b-de1f-418e-9482-cc9168e7e0b4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:50.077444 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-ba914e7b-de1f-418e-9482-cc9168e7e0b4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1725 microversion: 2.20 time: 0.140652 Aug 27 04:41:50.077997 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 594/1160] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:41:49 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1725 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:41:50.509434 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-a7a7e031-79d8-4ecd-89ec-237681e028d7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:50.510455 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-a7a7e031-79d8-4ecd-89ec-237681e028d7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:50.516989 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a7a7e031-79d8-4ecd-89ec-237681e028d7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:50.517438 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a7a7e031-79d8-4ecd-89ec-237681e028d7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:50.518200 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a7a7e031-79d8-4ecd-89ec-237681e028d7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:50.518641 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a7a7e031-79d8-4ecd-89ec-237681e028d7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:50.608299 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-a7a7e031-79d8-4ecd-89ec-237681e028d7 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28644 microversion: 2.1 time: 0.102745 Aug 27 04:41:50.608954 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 567/1161] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:41:50 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28644 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:41:51.094736 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-8162efa0-e50e-469b-897b-6c74eae62677 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:51.095346 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-8162efa0-e50e-469b-897b-6c74eae62677 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:51.101766 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8162efa0-e50e-469b-897b-6c74eae62677 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:51.102211 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8162efa0-e50e-469b-897b-6c74eae62677 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:51.102977 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8162efa0-e50e-469b-897b-6c74eae62677 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:51.103413 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8162efa0-e50e-469b-897b-6c74eae62677 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:51.220549 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-8162efa0-e50e-469b-897b-6c74eae62677 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:51.228899 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-8162efa0-e50e-469b-897b-6c74eae62677 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:51.230665 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-8162efa0-e50e-469b-897b-6c74eae62677 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:51.231798 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-8162efa0-e50e-469b-897b-6c74eae62677 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1725 microversion: 2.20 time: 0.140758 Aug 27 04:41:51.232385 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 595/1162] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:41:51 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1725 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:41:51.621399 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-7129fb89-b5c8-4c73-9cec-64644acaf94a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:51.622338 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-7129fb89-b5c8-4c73-9cec-64644acaf94a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:51.628909 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7129fb89-b5c8-4c73-9cec-64644acaf94a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:51.629350 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7129fb89-b5c8-4c73-9cec-64644acaf94a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:51.630140 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7129fb89-b5c8-4c73-9cec-64644acaf94a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:51.630577 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7129fb89-b5c8-4c73-9cec-64644acaf94a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:51.721975 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-7129fb89-b5c8-4c73-9cec-64644acaf94a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28644 microversion: 2.1 time: 0.104491 Aug 27 04:41:51.722624 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 568/1163] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:41:51 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28644 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:41:52.249722 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-d5784ace-fec4-40c2-80b7-b5a8fa903ce2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:52.250321 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-d5784ace-fec4-40c2-80b7-b5a8fa903ce2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:52.256860 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d5784ace-fec4-40c2-80b7-b5a8fa903ce2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:52.257308 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d5784ace-fec4-40c2-80b7-b5a8fa903ce2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:52.258068 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d5784ace-fec4-40c2-80b7-b5a8fa903ce2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:52.258499 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d5784ace-fec4-40c2-80b7-b5a8fa903ce2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:52.382908 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-d5784ace-fec4-40c2-80b7-b5a8fa903ce2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:52.390791 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-d5784ace-fec4-40c2-80b7-b5a8fa903ce2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:52.392381 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-d5784ace-fec4-40c2-80b7-b5a8fa903ce2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:52.393582 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-d5784ace-fec4-40c2-80b7-b5a8fa903ce2 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1725 microversion: 2.20 time: 0.147619 Aug 27 04:41:52.394149 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 596/1164] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:41:52 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:41:52.735358 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-50342e0b-6517-4dcf-a736-5ac955c09d0e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:52.736299 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-50342e0b-6517-4dcf-a736-5ac955c09d0e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:52.743410 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-50342e0b-6517-4dcf-a736-5ac955c09d0e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:52.743853 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-50342e0b-6517-4dcf-a736-5ac955c09d0e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:52.744643 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-50342e0b-6517-4dcf-a736-5ac955c09d0e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:52.745075 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-50342e0b-6517-4dcf-a736-5ac955c09d0e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:52.838685 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-50342e0b-6517-4dcf-a736-5ac955c09d0e tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28644 microversion: 2.1 time: 0.107226 Aug 27 04:41:52.839375 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 569/1165] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:41:52 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28644 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:41:53.414935 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-f0f33939-2e76-45f3-bd5c-ba755c487dc9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:53.415938 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-f0f33939-2e76-45f3-bd5c-ba755c487dc9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:53.422408 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f0f33939-2e76-45f3-bd5c-ba755c487dc9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:53.422857 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f0f33939-2e76-45f3-bd5c-ba755c487dc9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:53.423632 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f0f33939-2e76-45f3-bd5c-ba755c487dc9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:53.424109 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f0f33939-2e76-45f3-bd5c-ba755c487dc9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:53.549772 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-f0f33939-2e76-45f3-bd5c-ba755c487dc9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:53.557938 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-f0f33939-2e76-45f3-bd5c-ba755c487dc9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:53.559438 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-f0f33939-2e76-45f3-bd5c-ba755c487dc9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:53.560605 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-f0f33939-2e76-45f3-bd5c-ba755c487dc9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1725 microversion: 2.20 time: 0.151647 Aug 27 04:41:53.561164 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 597/1166] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:41:53 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:41:53.851540 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-8656d42f-1622-476e-afeb-6395d42fecf0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:53.852722 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-8656d42f-1622-476e-afeb-6395d42fecf0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:53.860891 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-8656d42f-1622-476e-afeb-6395d42fecf0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:53.861417 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-8656d42f-1622-476e-afeb-6395d42fecf0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:53.862330 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-8656d42f-1622-476e-afeb-6395d42fecf0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:53.862828 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-8656d42f-1622-476e-afeb-6395d42fecf0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:53.960939 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-8656d42f-1622-476e-afeb-6395d42fecf0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28644 microversion: 2.1 time: 0.113765 Aug 27 04:41:53.961616 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 570/1167] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:41:53 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28644 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:41:54.578503 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-257150ec-4e65-40fa-84ba-8f8061c1c037 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:54.579097 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-257150ec-4e65-40fa-84ba-8f8061c1c037 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:54.585610 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-257150ec-4e65-40fa-84ba-8f8061c1c037 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:54.586046 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-257150ec-4e65-40fa-84ba-8f8061c1c037 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:54.586793 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-257150ec-4e65-40fa-84ba-8f8061c1c037 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:54.587221 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-257150ec-4e65-40fa-84ba-8f8061c1c037 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:54.712649 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-257150ec-4e65-40fa-84ba-8f8061c1c037 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:54.720650 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-257150ec-4e65-40fa-84ba-8f8061c1c037 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:54.722149 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-257150ec-4e65-40fa-84ba-8f8061c1c037 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:54.723294 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-257150ec-4e65-40fa-84ba-8f8061c1c037 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1725 microversion: 2.20 time: 0.148490 Aug 27 04:41:54.723856 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 598/1168] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:41:54 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:41:54.977483 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-0fc6c34b-9513-4667-af41-359a9bd50ff4 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:54.978962 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-0fc6c34b-9513-4667-af41-359a9bd50ff4 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:54.986371 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0fc6c34b-9513-4667-af41-359a9bd50ff4 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:54.986825 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0fc6c34b-9513-4667-af41-359a9bd50ff4 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:54.987595 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0fc6c34b-9513-4667-af41-359a9bd50ff4 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:54.988055 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0fc6c34b-9513-4667-af41-359a9bd50ff4 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:55.077214 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-0fc6c34b-9513-4667-af41-359a9bd50ff4 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28644 microversion: 2.1 time: 0.106575 Aug 27 04:41:55.078135 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 571/1169] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:41:54 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28644 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:41:55.741556 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-85f320db-b5c3-4e14-8f44-c01eb80da99e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:55.742118 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-85f320db-b5c3-4e14-8f44-c01eb80da99e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:55.747964 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-85f320db-b5c3-4e14-8f44-c01eb80da99e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:55.748430 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-85f320db-b5c3-4e14-8f44-c01eb80da99e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:55.749187 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-85f320db-b5c3-4e14-8f44-c01eb80da99e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:55.749616 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-85f320db-b5c3-4e14-8f44-c01eb80da99e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:55.872475 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-85f320db-b5c3-4e14-8f44-c01eb80da99e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:55.880339 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-85f320db-b5c3-4e14-8f44-c01eb80da99e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:55.881822 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-85f320db-b5c3-4e14-8f44-c01eb80da99e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:55.882938 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-85f320db-b5c3-4e14-8f44-c01eb80da99e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1725 microversion: 2.20 time: 0.145189 Aug 27 04:41:55.883497 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 599/1170] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:41:55 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1725 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:41:56.090468 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-a95d6105-968e-4479-93bf-5f53b7a75d7f tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:56.091464 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-a95d6105-968e-4479-93bf-5f53b7a75d7f tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:56.098020 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a95d6105-968e-4479-93bf-5f53b7a75d7f tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:56.098477 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a95d6105-968e-4479-93bf-5f53b7a75d7f tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:56.099248 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a95d6105-968e-4479-93bf-5f53b7a75d7f tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:56.099691 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a95d6105-968e-4479-93bf-5f53b7a75d7f tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:56.208523 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-a95d6105-968e-4479-93bf-5f53b7a75d7f tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28644 microversion: 2.1 time: 0.121877 Aug 27 04:41:56.209190 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 572/1171] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:41:56 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28644 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:41:56.900347 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-fe40596e-e95c-48e4-bf95-c852fbaca9a9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:56.900951 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-fe40596e-e95c-48e4-bf95-c852fbaca9a9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:56.907032 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-fe40596e-e95c-48e4-bf95-c852fbaca9a9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:56.907473 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-fe40596e-e95c-48e4-bf95-c852fbaca9a9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:56.908264 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-fe40596e-e95c-48e4-bf95-c852fbaca9a9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:56.908695 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-fe40596e-e95c-48e4-bf95-c852fbaca9a9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:57.031031 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-fe40596e-e95c-48e4-bf95-c852fbaca9a9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:57.039448 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-fe40596e-e95c-48e4-bf95-c852fbaca9a9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:57.040894 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-fe40596e-e95c-48e4-bf95-c852fbaca9a9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:57.042036 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-fe40596e-e95c-48e4-bf95-c852fbaca9a9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1725 microversion: 2.20 time: 0.145393 Aug 27 04:41:57.042606 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 600/1172] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:41:56 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:41:57.221577 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-d4863eca-7f85-4e97-9ba9-bd3d61989afe tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:57.222576 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-d4863eca-7f85-4e97-9ba9-bd3d61989afe tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:57.230238 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d4863eca-7f85-4e97-9ba9-bd3d61989afe tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:57.230697 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d4863eca-7f85-4e97-9ba9-bd3d61989afe tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:57.231472 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d4863eca-7f85-4e97-9ba9-bd3d61989afe tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:57.231915 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d4863eca-7f85-4e97-9ba9-bd3d61989afe tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:57.314344 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-d4863eca-7f85-4e97-9ba9-bd3d61989afe tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28644 microversion: 2.1 time: 0.096538 Aug 27 04:41:57.314921 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 573/1173] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:41:57 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28644 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:41:58.060041 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-8651b70e-26bc-4c70-93e0-601b51aadbe1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:58.060640 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-8651b70e-26bc-4c70-93e0-601b51aadbe1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:58.066893 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8651b70e-26bc-4c70-93e0-601b51aadbe1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:58.072056 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8651b70e-26bc-4c70-93e0-601b51aadbe1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:58.072056 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8651b70e-26bc-4c70-93e0-601b51aadbe1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:58.072056 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8651b70e-26bc-4c70-93e0-601b51aadbe1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:58.194175 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-8651b70e-26bc-4c70-93e0-601b51aadbe1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:58.201981 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-8651b70e-26bc-4c70-93e0-601b51aadbe1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:58.203483 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-8651b70e-26bc-4c70-93e0-601b51aadbe1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:58.204665 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-8651b70e-26bc-4c70-93e0-601b51aadbe1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1725 microversion: 2.20 time: 0.148364 Aug 27 04:41:58.205230 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 601/1174] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:41:58 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:41:58.326667 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-a79af971-1961-4b2a-b08a-575402f27817 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:58.327663 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-a79af971-1961-4b2a-b08a-575402f27817 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:58.335147 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a79af971-1961-4b2a-b08a-575402f27817 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:58.335602 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a79af971-1961-4b2a-b08a-575402f27817 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:58.336421 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a79af971-1961-4b2a-b08a-575402f27817 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:58.336922 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a79af971-1961-4b2a-b08a-575402f27817 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:58.643823 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-a79af971-1961-4b2a-b08a-575402f27817 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28644 microversion: 2.1 time: 0.320959 Aug 27 04:41:58.644431 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 574/1175] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:41:58 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28644 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:41:59.222429 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-4abb94b6-eccb-4b02-a003-ecd31aeab36f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:41:59.223064 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-4abb94b6-eccb-4b02-a003-ecd31aeab36f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:59.229739 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-4abb94b6-eccb-4b02-a003-ecd31aeab36f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:59.230198 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-4abb94b6-eccb-4b02-a003-ecd31aeab36f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:59.230949 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-4abb94b6-eccb-4b02-a003-ecd31aeab36f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:59.231385 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-4abb94b6-eccb-4b02-a003-ecd31aeab36f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:59.356482 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-4abb94b6-eccb-4b02-a003-ecd31aeab36f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:59.364702 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-4abb94b6-eccb-4b02-a003-ecd31aeab36f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:59.366702 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-4abb94b6-eccb-4b02-a003-ecd31aeab36f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:41:59.367833 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-4abb94b6-eccb-4b02-a003-ecd31aeab36f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1746 microversion: 2.20 time: 0.149115 Aug 27 04:41:59.368589 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 602/1176] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:41:59 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1746 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:41:59.655289 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-e0d250f2-5fdc-4e61-bab6-0dbca06760c0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:41:59.656316 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-e0d250f2-5fdc-4e61-bab6-0dbca06760c0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:41:59.662821 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e0d250f2-5fdc-4e61-bab6-0dbca06760c0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:59.663268 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e0d250f2-5fdc-4e61-bab6-0dbca06760c0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:59.664055 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e0d250f2-5fdc-4e61-bab6-0dbca06760c0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:41:59.664495 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e0d250f2-5fdc-4e61-bab6-0dbca06760c0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:41:59.759144 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-e0d250f2-5fdc-4e61-bab6-0dbca06760c0 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28644 microversion: 2.1 time: 0.107671 Aug 27 04:41:59.760077 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 575/1177] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:41:59 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28644 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:42:00.386009 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-f551c0de-c7e7-41f8-9bc6-fc4440e99cc8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:00.386631 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-f551c0de-c7e7-41f8-9bc6-fc4440e99cc8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:00.392707 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f551c0de-c7e7-41f8-9bc6-fc4440e99cc8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:00.393156 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f551c0de-c7e7-41f8-9bc6-fc4440e99cc8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:00.393925 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f551c0de-c7e7-41f8-9bc6-fc4440e99cc8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:00.394360 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f551c0de-c7e7-41f8-9bc6-fc4440e99cc8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:00.519693 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-f551c0de-c7e7-41f8-9bc6-fc4440e99cc8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:00.528264 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-f551c0de-c7e7-41f8-9bc6-fc4440e99cc8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:00.529794 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-f551c0de-c7e7-41f8-9bc6-fc4440e99cc8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:00.530932 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-f551c0de-c7e7-41f8-9bc6-fc4440e99cc8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1746 microversion: 2.20 time: 0.148735 Aug 27 04:42:00.531484 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 603/1178] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:42:00 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1746 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:42:00.773154 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-11433058-35f9-41d1-ad78-94534f0f6895 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:00.774024 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-11433058-35f9-41d1-ad78-94534f0f6895 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:00.780970 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-11433058-35f9-41d1-ad78-94534f0f6895 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:00.781443 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-11433058-35f9-41d1-ad78-94534f0f6895 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:00.782240 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-11433058-35f9-41d1-ad78-94534f0f6895 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:00.782712 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-11433058-35f9-41d1-ad78-94534f0f6895 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:00.890403 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-11433058-35f9-41d1-ad78-94534f0f6895 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 28916 microversion: 2.1 time: 0.122635 Aug 27 04:42:00.891102 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 576/1179] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:42:00 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 28916 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:42:01.549554 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-a92e4fba-28ec-4e04-b93b-eb04ae05190d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:01.550163 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-a92e4fba-28ec-4e04-b93b-eb04ae05190d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:01.556126 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a92e4fba-28ec-4e04-b93b-eb04ae05190d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:01.556574 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a92e4fba-28ec-4e04-b93b-eb04ae05190d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:01.557342 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a92e4fba-28ec-4e04-b93b-eb04ae05190d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:01.557779 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a92e4fba-28ec-4e04-b93b-eb04ae05190d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:01.681243 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-a92e4fba-28ec-4e04-b93b-eb04ae05190d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:01.689928 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-a92e4fba-28ec-4e04-b93b-eb04ae05190d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:01.691501 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-a92e4fba-28ec-4e04-b93b-eb04ae05190d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:01.692698 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-a92e4fba-28ec-4e04-b93b-eb04ae05190d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1746 microversion: 2.20 time: 0.146884 Aug 27 04:42:01.693260 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 604/1180] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:42:01 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1746 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:42:01.903204 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-06cb0de1-0e80-4402-a44a-665dd51a3343 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:01.904142 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-06cb0de1-0e80-4402-a44a-665dd51a3343 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:01.910870 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-06cb0de1-0e80-4402-a44a-665dd51a3343 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:01.911323 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-06cb0de1-0e80-4402-a44a-665dd51a3343 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:01.912152 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-06cb0de1-0e80-4402-a44a-665dd51a3343 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:01.913251 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-06cb0de1-0e80-4402-a44a-665dd51a3343 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:02.013522 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-06cb0de1-0e80-4402-a44a-665dd51a3343 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 30914 microversion: 2.1 time: 0.114314 Aug 27 04:42:02.014178 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 577/1181] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:42:01 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 30914 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:42:02.711962 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-55f0206b-c2ff-4905-887e-74f0aaedc2c6 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:02.712724 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-55f0206b-c2ff-4905-887e-74f0aaedc2c6 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:02.718460 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-55f0206b-c2ff-4905-887e-74f0aaedc2c6 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:02.718906 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-55f0206b-c2ff-4905-887e-74f0aaedc2c6 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:02.719671 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-55f0206b-c2ff-4905-887e-74f0aaedc2c6 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:02.720128 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-55f0206b-c2ff-4905-887e-74f0aaedc2c6 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:02.785514 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [req-d2c7f3ed-531e-4cd7-94c5-dc978c352800 req-fb132ec5-53e9-428d-9c53-a7cbbb3466fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bbb8317-81d9-4e49-bd0b-32a4446ec505", "name": "network-vif-plugged", "status": "completed", "tag": "792a8fdf-832a-4455-8433-eb97d588eb8e"}]} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:02.789735 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:42:02.789735 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: warnings.warn(msg) Aug 27 04:42:02.804018 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-d2c7f3ed-531e-4cd7-94c5-dc978c352800 req-fb132ec5-53e9-428d-9c53-a7cbbb3466fb service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:02.804686 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-d2c7f3ed-531e-4cd7-94c5-dc978c352800 req-fb132ec5-53e9-428d-9c53-a7cbbb3466fb service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:02.823469 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.compute.server_external_events [req-d2c7f3ed-531e-4cd7-94c5-dc978c352800 req-fb132ec5-53e9-428d-9c53-a7cbbb3466fb service nova] Creating event network-vif-plugged:792a8fdf-832a-4455-8433-eb97d588eb8e for instance 4bbb8317-81d9-4e49-bd0b-32a4446ec505 on hv-cinder-80403 Aug 27 04:42:02.830532 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [req-d2c7f3ed-531e-4cd7-94c5-dc978c352800 req-fb132ec5-53e9-428d-9c53-a7cbbb3466fb service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049252 Aug 27 04:42:02.831540 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 578/1182] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:42:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:42:02.864590 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-55f0206b-c2ff-4905-887e-74f0aaedc2c6 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:02.873045 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-55f0206b-c2ff-4905-887e-74f0aaedc2c6 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:02.874546 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-55f0206b-c2ff-4905-887e-74f0aaedc2c6 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:02.875843 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-55f0206b-c2ff-4905-887e-74f0aaedc2c6 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1746 microversion: 2.20 time: 0.167693 Aug 27 04:42:02.879459 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 605/1183] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:42:02 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1746 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:42:03.025976 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-063ed077-aa28-4567-9a00-339c81b8b7cd tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:03.026975 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-063ed077-aa28-4567-9a00-339c81b8b7cd tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:03.033311 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-063ed077-aa28-4567-9a00-339c81b8b7cd tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:03.033762 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-063ed077-aa28-4567-9a00-339c81b8b7cd tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:03.034535 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-063ed077-aa28-4567-9a00-339c81b8b7cd tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:03.034979 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-063ed077-aa28-4567-9a00-339c81b8b7cd tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:03.140577 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-063ed077-aa28-4567-9a00-339c81b8b7cd tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 32837 microversion: 2.1 time: 0.118335 Aug 27 04:42:03.141110 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 579/1184] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:42:03 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 32837 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:42:03.894748 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-da99b131-4027-4e5f-afa0-7f1cfb7a00ba tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:03.895352 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-da99b131-4027-4e5f-afa0-7f1cfb7a00ba tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:03.902468 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-da99b131-4027-4e5f-afa0-7f1cfb7a00ba tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:03.902916 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-da99b131-4027-4e5f-afa0-7f1cfb7a00ba tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:03.903718 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-da99b131-4027-4e5f-afa0-7f1cfb7a00ba tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:03.904187 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-da99b131-4027-4e5f-afa0-7f1cfb7a00ba tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:04.030383 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-da99b131-4027-4e5f-afa0-7f1cfb7a00ba tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:04.039315 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-da99b131-4027-4e5f-afa0-7f1cfb7a00ba tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:04.040896 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-da99b131-4027-4e5f-afa0-7f1cfb7a00ba tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:04.042113 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-da99b131-4027-4e5f-afa0-7f1cfb7a00ba tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1746 microversion: 2.20 time: 0.151098 Aug 27 04:42:04.042678 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 606/1185] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:42:03 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:42:04.153859 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-c0aa0eb5-d70c-4d0e-8c1d-2972375b1067 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:04.154770 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-c0aa0eb5-d70c-4d0e-8c1d-2972375b1067 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:04.161398 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-c0aa0eb5-d70c-4d0e-8c1d-2972375b1067 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:04.161847 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-c0aa0eb5-d70c-4d0e-8c1d-2972375b1067 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:04.163256 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-c0aa0eb5-d70c-4d0e-8c1d-2972375b1067 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:04.163692 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-c0aa0eb5-d70c-4d0e-8c1d-2972375b1067 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:04.259015 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-c0aa0eb5-d70c-4d0e-8c1d-2972375b1067 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 33874 microversion: 2.1 time: 0.108633 Aug 27 04:42:04.260138 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 580/1186] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:42:04 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 33874 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:42:05.061287 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-b7282415-83bb-4c9f-bca0-4f51fae76c11 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:05.061880 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-b7282415-83bb-4c9f-bca0-4f51fae76c11 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:05.067872 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b7282415-83bb-4c9f-bca0-4f51fae76c11 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:05.068347 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b7282415-83bb-4c9f-bca0-4f51fae76c11 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:05.069202 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b7282415-83bb-4c9f-bca0-4f51fae76c11 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:05.069645 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b7282415-83bb-4c9f-bca0-4f51fae76c11 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:05.196836 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-b7282415-83bb-4c9f-bca0-4f51fae76c11 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:05.204882 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-b7282415-83bb-4c9f-bca0-4f51fae76c11 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:05.206357 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-b7282415-83bb-4c9f-bca0-4f51fae76c11 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:05.207488 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-b7282415-83bb-4c9f-bca0-4f51fae76c11 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1746 microversion: 2.20 time: 0.149947 Aug 27 04:42:05.208056 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 607/1187] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:42:05 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1746 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:42:05.271229 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-fe103304-50fd-4039-bd24-349c28cdfd1c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:05.272267 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-fe103304-50fd-4039-bd24-349c28cdfd1c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:05.278850 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fe103304-50fd-4039-bd24-349c28cdfd1c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:05.279300 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fe103304-50fd-4039-bd24-349c28cdfd1c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:05.280106 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fe103304-50fd-4039-bd24-349c28cdfd1c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:05.280552 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fe103304-50fd-4039-bd24-349c28cdfd1c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:05.373660 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-fe103304-50fd-4039-bd24-349c28cdfd1c tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 35192 microversion: 2.1 time: 0.106291 Aug 27 04:42:05.374307 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 581/1188] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:42:05 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 35192 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:42:06.226145 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-2b3e949e-f930-4caa-9124-27f0ce8c2af4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:06.227016 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-2b3e949e-f930-4caa-9124-27f0ce8c2af4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:06.235671 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-2b3e949e-f930-4caa-9124-27f0ce8c2af4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:06.238259 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-2b3e949e-f930-4caa-9124-27f0ce8c2af4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:06.239297 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-2b3e949e-f930-4caa-9124-27f0ce8c2af4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:06.239972 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-2b3e949e-f930-4caa-9124-27f0ce8c2af4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:06.388353 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-2b3e949e-f930-4caa-9124-27f0ce8c2af4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:06.388964 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-15c9855e-66f9-4520-939d-5cdfc76fbe62 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:06.393922 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-15c9855e-66f9-4520-939d-5cdfc76fbe62 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:06.397428 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-2b3e949e-f930-4caa-9124-27f0ce8c2af4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:06.398956 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-2b3e949e-f930-4caa-9124-27f0ce8c2af4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:06.400176 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-2b3e949e-f930-4caa-9124-27f0ce8c2af4 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1741 microversion: 2.20 time: 0.178273 Aug 27 04:42:06.401583 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 608/1189] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:42:06 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1741 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:42:06.403971 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-15c9855e-66f9-4520-939d-5cdfc76fbe62 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:06.405039 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-15c9855e-66f9-4520-939d-5cdfc76fbe62 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:06.406656 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-15c9855e-66f9-4520-939d-5cdfc76fbe62 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:06.407642 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-15c9855e-66f9-4520-939d-5cdfc76fbe62 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:06.518940 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-15c9855e-66f9-4520-939d-5cdfc76fbe62 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 36490 microversion: 2.1 time: 0.133746 Aug 27 04:42:06.524320 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 582/1190] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:42:06 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 36490 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:42:07.421723 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-3e1c641e-4094-458d-af1a-f22b2b89fa2c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:07.422519 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-3e1c641e-4094-458d-af1a-f22b2b89fa2c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:07.430512 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3e1c641e-4094-458d-af1a-f22b2b89fa2c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:07.430974 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3e1c641e-4094-458d-af1a-f22b2b89fa2c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:07.431763 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3e1c641e-4094-458d-af1a-f22b2b89fa2c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:07.432456 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3e1c641e-4094-458d-af1a-f22b2b89fa2c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:07.533055 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-addc7ae8-de12-4537-98f4-f1b7d64e1afb tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:07.535095 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-addc7ae8-de12-4537-98f4-f1b7d64e1afb tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:07.556342 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-addc7ae8-de12-4537-98f4-f1b7d64e1afb tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:07.557112 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-addc7ae8-de12-4537-98f4-f1b7d64e1afb tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:07.558293 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-addc7ae8-de12-4537-98f4-f1b7d64e1afb tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:07.558739 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-addc7ae8-de12-4537-98f4-f1b7d64e1afb tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:07.579526 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-3e1c641e-4094-458d-af1a-f22b2b89fa2c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:07.590698 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-3e1c641e-4094-458d-af1a-f22b2b89fa2c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:07.590698 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-3e1c641e-4094-458d-af1a-f22b2b89fa2c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:07.591475 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-3e1c641e-4094-458d-af1a-f22b2b89fa2c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1741 microversion: 2.20 time: 0.175602 Aug 27 04:42:07.603255 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 609/1191] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:42:07 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1741 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:42:07.680701 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-addc7ae8-de12-4537-98f4-f1b7d64e1afb tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 37990 microversion: 2.1 time: 0.151397 Aug 27 04:42:07.682201 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 583/1192] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:42:07 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 37990 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:42:08.610125 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-c2f50cc5-3cd9-4aa6-8a2d-dfceeb134a0d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:08.610950 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-c2f50cc5-3cd9-4aa6-8a2d-dfceeb134a0d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:08.618010 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c2f50cc5-3cd9-4aa6-8a2d-dfceeb134a0d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:08.618555 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c2f50cc5-3cd9-4aa6-8a2d-dfceeb134a0d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:08.619416 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c2f50cc5-3cd9-4aa6-8a2d-dfceeb134a0d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:08.619920 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c2f50cc5-3cd9-4aa6-8a2d-dfceeb134a0d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:08.697130 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-800feaa5-b74a-469e-8f6c-385a5453bfdf tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:08.698786 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-800feaa5-b74a-469e-8f6c-385a5453bfdf tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:08.714010 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-800feaa5-b74a-469e-8f6c-385a5453bfdf tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:08.714935 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-800feaa5-b74a-469e-8f6c-385a5453bfdf tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:08.715664 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-800feaa5-b74a-469e-8f6c-385a5453bfdf tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:08.716438 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-800feaa5-b74a-469e-8f6c-385a5453bfdf tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:08.759814 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-c2f50cc5-3cd9-4aa6-8a2d-dfceeb134a0d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:08.768341 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-c2f50cc5-3cd9-4aa6-8a2d-dfceeb134a0d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:08.769850 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-c2f50cc5-3cd9-4aa6-8a2d-dfceeb134a0d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:08.771004 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-c2f50cc5-3cd9-4aa6-8a2d-dfceeb134a0d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1741 microversion: 2.20 time: 0.164809 Aug 27 04:42:08.771801 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 610/1193] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:42:08 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1741 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:42:08.843329 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-800feaa5-b74a-469e-8f6c-385a5453bfdf tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 38177 microversion: 2.1 time: 0.151372 Aug 27 04:42:08.843974 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 584/1194] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:42:08 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 38177 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:42:09.791331 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-0ab526d7-7518-4633-906f-11fcbb8d1ebe tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:09.792237 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-0ab526d7-7518-4633-906f-11fcbb8d1ebe tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:09.799583 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0ab526d7-7518-4633-906f-11fcbb8d1ebe tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:09.800148 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0ab526d7-7518-4633-906f-11fcbb8d1ebe tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:09.801138 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0ab526d7-7518-4633-906f-11fcbb8d1ebe tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:09.801568 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0ab526d7-7518-4633-906f-11fcbb8d1ebe tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:09.856974 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-7031e183-b556-4850-aed9-4b02c5120278 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:09.858664 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-7031e183-b556-4850-aed9-4b02c5120278 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:09.866549 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7031e183-b556-4850-aed9-4b02c5120278 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:09.867298 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7031e183-b556-4850-aed9-4b02c5120278 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:09.868298 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7031e183-b556-4850-aed9-4b02c5120278 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:09.868931 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7031e183-b556-4850-aed9-4b02c5120278 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:09.956722 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-0ab526d7-7518-4633-906f-11fcbb8d1ebe tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:09.966498 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-0ab526d7-7518-4633-906f-11fcbb8d1ebe tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:09.969296 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-0ab526d7-7518-4633-906f-11fcbb8d1ebe tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:09.969542 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-0ab526d7-7518-4633-906f-11fcbb8d1ebe tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1741 microversion: 2.20 time: 0.182574 Aug 27 04:42:09.970570 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 611/1195] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:42:09 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1741 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:42:09.973338 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-7031e183-b556-4850-aed9-4b02c5120278 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 38177 microversion: 2.1 time: 0.120727 Aug 27 04:42:09.978152 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 585/1196] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:42:09 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 38177 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:42:10.991869 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-12314896-40e3-4217-9036-29f833645b4d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:10.992689 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-12314896-40e3-4217-9036-29f833645b4d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:10.995353 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-66faaba9-07c6-4d56-ae45-6988b4ed3129 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:11.000524 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-66faaba9-07c6-4d56-ae45-6988b4ed3129 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:11.014445 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-12314896-40e3-4217-9036-29f833645b4d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:11.014899 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-12314896-40e3-4217-9036-29f833645b4d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:11.017260 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-12314896-40e3-4217-9036-29f833645b4d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:11.018221 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-66faaba9-07c6-4d56-ae45-6988b4ed3129 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:11.019037 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-12314896-40e3-4217-9036-29f833645b4d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:11.022999 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-66faaba9-07c6-4d56-ae45-6988b4ed3129 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:11.024165 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-66faaba9-07c6-4d56-ae45-6988b4ed3129 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:11.024681 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-66faaba9-07c6-4d56-ae45-6988b4ed3129 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:11.152040 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-66faaba9-07c6-4d56-ae45-6988b4ed3129 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 38177 microversion: 2.1 time: 0.168098 Aug 27 04:42:11.153217 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 612/1197] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:42:10 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 38177 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:42:11.188477 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-12314896-40e3-4217-9036-29f833645b4d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:11.197714 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-12314896-40e3-4217-9036-29f833645b4d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:11.199334 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-12314896-40e3-4217-9036-29f833645b4d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:11.200903 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-12314896-40e3-4217-9036-29f833645b4d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1741 microversion: 2.20 time: 0.213895 Aug 27 04:42:11.212819 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 586/1198] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:42:10 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1741 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:42:12.165493 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-87565be2-22ee-4a99-81b8-c65364be88e8 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:12.166635 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-87565be2-22ee-4a99-81b8-c65364be88e8 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:12.175334 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-87565be2-22ee-4a99-81b8-c65364be88e8 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:12.178027 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-87565be2-22ee-4a99-81b8-c65364be88e8 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:12.178971 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-87565be2-22ee-4a99-81b8-c65364be88e8 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:12.179576 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-87565be2-22ee-4a99-81b8-c65364be88e8 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:12.219798 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-a043344a-bbf6-43c1-aca0-48abadb096e3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:12.220473 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-a043344a-bbf6-43c1-aca0-48abadb096e3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:12.227871 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a043344a-bbf6-43c1-aca0-48abadb096e3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:12.228608 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a043344a-bbf6-43c1-aca0-48abadb096e3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:12.229619 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a043344a-bbf6-43c1-aca0-48abadb096e3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:12.230185 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a043344a-bbf6-43c1-aca0-48abadb096e3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:12.279705 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-87565be2-22ee-4a99-81b8-c65364be88e8 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action" status: 200 len: 38308 microversion: 2.1 time: 0.118953 Aug 27 04:42:12.280423 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 613/1199] 10.222.0.53 () {60 vars in 1278 bytes} [Fri Aug 27 04:42:12 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/action => generated 38308 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:42:12.292630 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-67abd437-4e51-4b83-b582-f8094122cb64 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:12.293304 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-67abd437-4e51-4b83-b582-f8094122cb64 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:12.304695 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-67abd437-4e51-4b83-b582-f8094122cb64 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:12.305305 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-67abd437-4e51-4b83-b582-f8094122cb64 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:12.306185 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-67abd437-4e51-4b83-b582-f8094122cb64 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:12.306960 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-67abd437-4e51-4b83-b582-f8094122cb64 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:12.344146 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-67abd437-4e51-4b83-b582-f8094122cb64 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/ips" status: 200 len: 146 microversion: 2.1 time: 0.054365 Aug 27 04:42:12.353542 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 614/1200] 10.222.0.53 () {58 vars in 1248 bytes} [Fri Aug 27 04:42:12 2021] GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/ips => generated 146 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:42:12.526930 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-a043344a-bbf6-43c1-aca0-48abadb096e3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:12.537626 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-a043344a-bbf6-43c1-aca0-48abadb096e3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:12.539205 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-a043344a-bbf6-43c1-aca0-48abadb096e3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:12.540582 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-a043344a-bbf6-43c1-aca0-48abadb096e3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1741 microversion: 2.20 time: 0.324630 Aug 27 04:42:12.541621 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 587/1201] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:42:12 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1741 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:42:13.561980 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-1689ccb7-ade1-404d-9e44-2f306accc5eb tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:13.562594 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-1689ccb7-ade1-404d-9e44-2f306accc5eb tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:13.571153 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1689ccb7-ade1-404d-9e44-2f306accc5eb tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:13.572623 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1689ccb7-ade1-404d-9e44-2f306accc5eb tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:13.574765 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1689ccb7-ade1-404d-9e44-2f306accc5eb tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:13.575517 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1689ccb7-ade1-404d-9e44-2f306accc5eb tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:13.736697 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-1689ccb7-ade1-404d-9e44-2f306accc5eb tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:13.754353 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-1689ccb7-ade1-404d-9e44-2f306accc5eb tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:13.755926 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-1689ccb7-ade1-404d-9e44-2f306accc5eb tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:13.763054 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-1689ccb7-ade1-404d-9e44-2f306accc5eb tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1741 microversion: 2.20 time: 0.206515 Aug 27 04:42:13.766355 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 615/1202] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:42:13 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1741 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:42:13.780565 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-3b6cf1e8-e868-4c97-80f4-ef3fe04e969b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dbf51ce0-a134-47d3-869a-842136a86b39"}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:13.781977 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-3b6cf1e8-e868-4c97-80f4-ef3fe04e969b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:13.789374 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3b6cf1e8-e868-4c97-80f4-ef3fe04e969b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:13.789820 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3b6cf1e8-e868-4c97-80f4-ef3fe04e969b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:13.790694 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3b6cf1e8-e868-4c97-80f4-ef3fe04e969b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:13.791041 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3b6cf1e8-e868-4c97-80f4-ef3fe04e969b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:14.124755 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-3b6cf1e8-e868-4c97-80f4-ef3fe04e969b tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.347681 Aug 27 04:42:14.126013 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 588/1203] 10.222.0.53 () {60 vars in 1323 bytes} [Fri Aug 27 04:42:13 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/os-volume_attachments => generated 194 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:42:14.785504 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-0a1b2f84-817d-420b-b00c-a9ff95ba831d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:14.786319 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-0a1b2f84-817d-420b-b00c-a9ff95ba831d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:14.792950 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0a1b2f84-817d-420b-b00c-a9ff95ba831d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:14.793532 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0a1b2f84-817d-420b-b00c-a9ff95ba831d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:14.794528 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0a1b2f84-817d-420b-b00c-a9ff95ba831d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:14.794971 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0a1b2f84-817d-420b-b00c-a9ff95ba831d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:14.946490 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-0a1b2f84-817d-420b-b00c-a9ff95ba831d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:14.955583 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-0a1b2f84-817d-420b-b00c-a9ff95ba831d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:14.957177 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-0a1b2f84-817d-420b-b00c-a9ff95ba831d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:14.958690 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-0a1b2f84-817d-420b-b00c-a9ff95ba831d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1741 microversion: 2.20 time: 0.177303 Aug 27 04:42:14.959977 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 616/1204] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:42:14 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1741 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:42:15.979263 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-39afa074-53a2-474d-8adf-489cb3d880ae tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:15.980274 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-39afa074-53a2-474d-8adf-489cb3d880ae tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:15.987143 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-39afa074-53a2-474d-8adf-489cb3d880ae tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:15.987591 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-39afa074-53a2-474d-8adf-489cb3d880ae tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:15.988384 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-39afa074-53a2-474d-8adf-489cb3d880ae tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:15.988831 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-39afa074-53a2-474d-8adf-489cb3d880ae tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:16.107105 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-39afa074-53a2-474d-8adf-489cb3d880ae tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:16.114915 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-39afa074-53a2-474d-8adf-489cb3d880ae tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:16.116454 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-39afa074-53a2-474d-8adf-489cb3d880ae tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:16.117569 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-39afa074-53a2-474d-8adf-489cb3d880ae tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1741 microversion: 2.20 time: 0.143466 Aug 27 04:42:16.118108 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 589/1205] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:42:15 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1741 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:42:17.135490 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-f61c854f-34f5-4b2b-aa9f-2cf689741e9f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:17.136060 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-f61c854f-34f5-4b2b-aa9f-2cf689741e9f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:17.142861 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f61c854f-34f5-4b2b-aa9f-2cf689741e9f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:17.143302 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f61c854f-34f5-4b2b-aa9f-2cf689741e9f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:17.144087 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f61c854f-34f5-4b2b-aa9f-2cf689741e9f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:17.144519 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f61c854f-34f5-4b2b-aa9f-2cf689741e9f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:17.268037 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-f61c854f-34f5-4b2b-aa9f-2cf689741e9f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:17.275928 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-f61c854f-34f5-4b2b-aa9f-2cf689741e9f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:17.277458 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-f61c854f-34f5-4b2b-aa9f-2cf689741e9f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:17.278594 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-f61c854f-34f5-4b2b-aa9f-2cf689741e9f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1723 microversion: 2.20 time: 0.147063 Aug 27 04:42:17.279157 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 617/1206] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:42:17 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:42:18.297555 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-79a1e5ef-1745-4cd9-9866-c740d617c5c7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:18.298087 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-79a1e5ef-1745-4cd9-9866-c740d617c5c7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:18.304986 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-79a1e5ef-1745-4cd9-9866-c740d617c5c7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:18.305424 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-79a1e5ef-1745-4cd9-9866-c740d617c5c7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:18.306230 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-79a1e5ef-1745-4cd9-9866-c740d617c5c7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:18.306660 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-79a1e5ef-1745-4cd9-9866-c740d617c5c7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:18.431795 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-79a1e5ef-1745-4cd9-9866-c740d617c5c7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:18.439488 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-79a1e5ef-1745-4cd9-9866-c740d617c5c7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:18.441004 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-79a1e5ef-1745-4cd9-9866-c740d617c5c7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:18.442516 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-79a1e5ef-1745-4cd9-9866-c740d617c5c7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1723 microversion: 2.20 time: 0.148753 Aug 27 04:42:18.443053 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 590/1207] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:42:18 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:42:18.854339 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [req-d0a7b8e6-26bc-4d88-9f91-3bd39c83b682 req-c8a1a32b-4c09-4e77-b8bf-b421a7f0d102 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bbb8317-81d9-4e49-bd0b-32a4446ec505", "name": "network-vif-unplugged", "status": "completed", "tag": "792a8fdf-832a-4455-8433-eb97d588eb8e"}]} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:18.856244 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:42:18.856244 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: warnings.warn(msg) Aug 27 04:42:18.865880 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-d0a7b8e6-26bc-4d88-9f91-3bd39c83b682 req-c8a1a32b-4c09-4e77-b8bf-b421a7f0d102 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:18.866327 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-d0a7b8e6-26bc-4d88-9f91-3bd39c83b682 req-c8a1a32b-4c09-4e77-b8bf-b421a7f0d102 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:18.877544 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.compute.server_external_events [req-d0a7b8e6-26bc-4d88-9f91-3bd39c83b682 req-c8a1a32b-4c09-4e77-b8bf-b421a7f0d102 service nova] Creating event network-vif-unplugged:792a8fdf-832a-4455-8433-eb97d588eb8e for instance 4bbb8317-81d9-4e49-bd0b-32a4446ec505 on hv-cinder-80403 Aug 27 04:42:18.882869 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [req-d0a7b8e6-26bc-4d88-9f91-3bd39c83b682 req-c8a1a32b-4c09-4e77-b8bf-b421a7f0d102 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033235 Aug 27 04:42:18.883719 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 618/1208] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:42:18 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:42:19.462497 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-6af3cc04-3f45-44c6-b9f4-498d5a6d9d0b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:19.463110 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-6af3cc04-3f45-44c6-b9f4-498d5a6d9d0b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:19.469402 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6af3cc04-3f45-44c6-b9f4-498d5a6d9d0b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:19.469850 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6af3cc04-3f45-44c6-b9f4-498d5a6d9d0b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:19.470618 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6af3cc04-3f45-44c6-b9f4-498d5a6d9d0b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:19.471053 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6af3cc04-3f45-44c6-b9f4-498d5a6d9d0b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:19.591540 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-6af3cc04-3f45-44c6-b9f4-498d5a6d9d0b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:19.599312 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-6af3cc04-3f45-44c6-b9f4-498d5a6d9d0b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:19.601342 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-6af3cc04-3f45-44c6-b9f4-498d5a6d9d0b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:19.602462 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-6af3cc04-3f45-44c6-b9f4-498d5a6d9d0b tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1666 microversion: 2.20 time: 0.143673 Aug 27 04:42:19.603011 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 591/1209] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:42:19 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1666 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:42:19.620962 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-1e6e6524-c0ea-44d9-af45-51de3d33aea7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fb76e1cd-4094-4808-9734-7e96e583858c"}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:19.622040 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-1e6e6524-c0ea-44d9-af45-51de3d33aea7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:19.628391 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1e6e6524-c0ea-44d9-af45-51de3d33aea7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:19.628836 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1e6e6524-c0ea-44d9-af45-51de3d33aea7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:19.629649 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1e6e6524-c0ea-44d9-af45-51de3d33aea7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:19.630193 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1e6e6524-c0ea-44d9-af45-51de3d33aea7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:19.906650 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-1e6e6524-c0ea-44d9-af45-51de3d33aea7 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.289731 Aug 27 04:42:19.907287 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 619/1210] 10.222.0.53 () {62 vars in 1364 bytes} [Fri Aug 27 04:42:19 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/os-volume_attachments => generated 188 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:42:20.028335 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-4001003b-cd7d-4e11-b0da-33c9a3cfa4af tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:20.028815 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-4001003b-cd7d-4e11-b0da-33c9a3cfa4af tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:20.034621 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4001003b-cd7d-4e11-b0da-33c9a3cfa4af tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:20.035064 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4001003b-cd7d-4e11-b0da-33c9a3cfa4af tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:20.035816 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4001003b-cd7d-4e11-b0da-33c9a3cfa4af tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:20.036273 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4001003b-cd7d-4e11-b0da-33c9a3cfa4af tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:20.314010 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-4001003b-cd7d-4e11-b0da-33c9a3cfa4af tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "DELETE /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/os-volume_attachments/fb76e1cd-4094-4808-9734-7e96e583858c" status: 202 len: 0 microversion: 2.20 time: 0.289268 Aug 27 04:42:20.314811 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 592/1211] 10.222.0.53 () {60 vars in 1457 bytes} [Fri Aug 27 04:42:20 2021] DELETE /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/os-volume_attachments/fb76e1cd-4094-4808-9734-7e96e583858c => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:42:20.373442 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-1bfdd939-93f9-44fc-8ed5-bb5cf3cb4009 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:20.373998 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-1bfdd939-93f9-44fc-8ed5-bb5cf3cb4009 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:20.379855 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1bfdd939-93f9-44fc-8ed5-bb5cf3cb4009 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:20.380334 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1bfdd939-93f9-44fc-8ed5-bb5cf3cb4009 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:20.381122 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1bfdd939-93f9-44fc-8ed5-bb5cf3cb4009 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:20.381551 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1bfdd939-93f9-44fc-8ed5-bb5cf3cb4009 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:20.455605 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-1bfdd939-93f9-44fc-8ed5-bb5cf3cb4009 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action" status: 202 len: 0 microversion: 2.20 time: 0.085688 Aug 27 04:42:20.456216 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 620/1212] 10.222.0.53 () {62 vars in 1319 bytes} [Fri Aug 27 04:42:20 2021] POST /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:42:20.464581 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-e326fc2e-3bf2-4857-8bb5-56275cc6099c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:20.465284 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-e326fc2e-3bf2-4857-8bb5-56275cc6099c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:20.472190 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e326fc2e-3bf2-4857-8bb5-56275cc6099c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:20.472620 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e326fc2e-3bf2-4857-8bb5-56275cc6099c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:20.473400 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e326fc2e-3bf2-4857-8bb5-56275cc6099c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:20.473833 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e326fc2e-3bf2-4857-8bb5-56275cc6099c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:20.600799 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-e326fc2e-3bf2-4857-8bb5-56275cc6099c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:20.609297 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-e326fc2e-3bf2-4857-8bb5-56275cc6099c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:20.610801 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-e326fc2e-3bf2-4857-8bb5-56275cc6099c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:20.611955 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-e326fc2e-3bf2-4857-8bb5-56275cc6099c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1674 microversion: 2.20 time: 0.151050 Aug 27 04:42:20.616131 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 593/1213] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:42:20 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:42:21.633153 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-38eaaf0b-6ada-40ae-bd93-8a8fccd04bcb tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:21.634200 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-38eaaf0b-6ada-40ae-bd93-8a8fccd04bcb tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:21.644637 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-38eaaf0b-6ada-40ae-bd93-8a8fccd04bcb tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:21.645437 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-38eaaf0b-6ada-40ae-bd93-8a8fccd04bcb tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:21.646825 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-38eaaf0b-6ada-40ae-bd93-8a8fccd04bcb tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:21.647621 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-38eaaf0b-6ada-40ae-bd93-8a8fccd04bcb tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:21.837820 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-38eaaf0b-6ada-40ae-bd93-8a8fccd04bcb tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:21.845518 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-38eaaf0b-6ada-40ae-bd93-8a8fccd04bcb tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:21.847021 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-38eaaf0b-6ada-40ae-bd93-8a8fccd04bcb tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:21.848195 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-38eaaf0b-6ada-40ae-bd93-8a8fccd04bcb tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1732 microversion: 2.20 time: 0.221808 Aug 27 04:42:21.848765 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 621/1214] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:42:21 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1732 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:42:22.009701 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-394bc16a-c26a-458e-8deb-c38313d35f56 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:22.010683 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-394bc16a-c26a-458e-8deb-c38313d35f56 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:22.016876 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-394bc16a-c26a-458e-8deb-c38313d35f56 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:22.017329 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-394bc16a-c26a-458e-8deb-c38313d35f56 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:22.018115 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-394bc16a-c26a-458e-8deb-c38313d35f56 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:22.018558 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-394bc16a-c26a-458e-8deb-c38313d35f56 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:22.050048 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-394bc16a-c26a-458e-8deb-c38313d35f56 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043937 Aug 27 04:42:22.050628 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 594/1215] 10.222.0.53 () {58 vars in 1302 bytes} [Fri Aug 27 04:42:22 2021] GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:42:22.060577 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-ec94ee8b-bcb0-44af-a3ba-3ee2653bd3c6 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:22.061260 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-ec94ee8b-bcb0-44af-a3ba-3ee2653bd3c6 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:22.067216 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ec94ee8b-bcb0-44af-a3ba-3ee2653bd3c6 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:22.067746 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ec94ee8b-bcb0-44af-a3ba-3ee2653bd3c6 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:22.068621 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ec94ee8b-bcb0-44af-a3ba-3ee2653bd3c6 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:22.069117 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ec94ee8b-bcb0-44af-a3ba-3ee2653bd3c6 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:22.103684 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-ec94ee8b-bcb0-44af-a3ba-3ee2653bd3c6 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/os-volume_attachments/dbf51ce0-a134-47d3-869a-842136a86b39" status: 200 len: 194 microversion: 2.1 time: 0.046796 Aug 27 04:42:22.104690 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 622/1216] 10.222.0.53 () {58 vars in 1413 bytes} [Fri Aug 27 04:42:22 2021] GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/os-volume_attachments/dbf51ce0-a134-47d3-869a-842136a86b39 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:42:22.871317 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-f95971c1-b14e-45b4-abd1-25601e69ea38 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:22.872267 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-f95971c1-b14e-45b4-abd1-25601e69ea38 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:22.885420 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f95971c1-b14e-45b4-abd1-25601e69ea38 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:22.885992 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f95971c1-b14e-45b4-abd1-25601e69ea38 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:22.886879 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f95971c1-b14e-45b4-abd1-25601e69ea38 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:22.887386 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f95971c1-b14e-45b4-abd1-25601e69ea38 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:23.038192 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-f95971c1-b14e-45b4-abd1-25601e69ea38 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:23.046255 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-f95971c1-b14e-45b4-abd1-25601e69ea38 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:23.047763 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-f95971c1-b14e-45b4-abd1-25601e69ea38 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:23.048942 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-f95971c1-b14e-45b4-abd1-25601e69ea38 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1732 microversion: 2.20 time: 0.185575 Aug 27 04:42:23.053116 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 595/1217] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:42:22 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1732 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:42:23.428757 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-ac7504ff-2905-4f7e-b4da-85dbf5053a17 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef665d7e-e00c-44cb-a8d0-e8bd4e0b4467"}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:23.429900 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-ac7504ff-2905-4f7e-b4da-85dbf5053a17 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:23.435822 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ac7504ff-2905-4f7e-b4da-85dbf5053a17 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:23.436502 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ac7504ff-2905-4f7e-b4da-85dbf5053a17 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:23.437272 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ac7504ff-2905-4f7e-b4da-85dbf5053a17 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:23.437701 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-ac7504ff-2905-4f7e-b4da-85dbf5053a17 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:24.070478 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-1840bfa0-8e89-49bf-b999-959c0441caf8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:24.071090 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-1840bfa0-8e89-49bf-b999-959c0441caf8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:24.077055 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1840bfa0-8e89-49bf-b999-959c0441caf8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:24.077494 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1840bfa0-8e89-49bf-b999-959c0441caf8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:24.078272 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1840bfa0-8e89-49bf-b999-959c0441caf8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:24.078716 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1840bfa0-8e89-49bf-b999-959c0441caf8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:24.212972 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-1840bfa0-8e89-49bf-b999-959c0441caf8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:24.221128 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-1840bfa0-8e89-49bf-b999-959c0441caf8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:24.222629 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-1840bfa0-8e89-49bf-b999-959c0441caf8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:24.223770 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-1840bfa0-8e89-49bf-b999-959c0441caf8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1732 microversion: 2.20 time: 0.157155 Aug 27 04:42:24.224356 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 596/1218] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:42:24 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:42:25.243360 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-5069cd38-a2d1-4a4c-b232-c54e27d41a66 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:25.244952 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-5069cd38-a2d1-4a4c-b232-c54e27d41a66 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:25.251935 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5069cd38-a2d1-4a4c-b232-c54e27d41a66 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:25.252772 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5069cd38-a2d1-4a4c-b232-c54e27d41a66 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:25.253789 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5069cd38-a2d1-4a4c-b232-c54e27d41a66 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:25.254459 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5069cd38-a2d1-4a4c-b232-c54e27d41a66 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:25.388209 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-5069cd38-a2d1-4a4c-b232-c54e27d41a66 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:25.396323 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-5069cd38-a2d1-4a4c-b232-c54e27d41a66 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:25.398479 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-5069cd38-a2d1-4a4c-b232-c54e27d41a66 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:25.399608 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-5069cd38-a2d1-4a4c-b232-c54e27d41a66 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1732 microversion: 2.20 time: 0.160612 Aug 27 04:42:25.400187 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 597/1219] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:42:25 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:42:26.418285 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-37935fc5-0344-49a1-9038-1e042224dbb1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:26.418955 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-37935fc5-0344-49a1-9038-1e042224dbb1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:26.433157 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-37935fc5-0344-49a1-9038-1e042224dbb1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:26.433603 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-37935fc5-0344-49a1-9038-1e042224dbb1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:26.434386 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-37935fc5-0344-49a1-9038-1e042224dbb1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:26.434822 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-37935fc5-0344-49a1-9038-1e042224dbb1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:26.579509 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-37935fc5-0344-49a1-9038-1e042224dbb1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:26.588041 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-37935fc5-0344-49a1-9038-1e042224dbb1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:26.589555 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-37935fc5-0344-49a1-9038-1e042224dbb1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:26.590719 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-37935fc5-0344-49a1-9038-1e042224dbb1 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1732 microversion: 2.20 time: 0.176188 Aug 27 04:42:26.604325 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 598/1220] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:42:26 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1732 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:42:27.013470 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-6d671ef1-a8a1-4047-8895-c05f22a09c72 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:27.013962 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-6d671ef1-a8a1-4047-8895-c05f22a09c72 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:27.020016 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6d671ef1-a8a1-4047-8895-c05f22a09c72 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:27.020479 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6d671ef1-a8a1-4047-8895-c05f22a09c72 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:27.021255 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6d671ef1-a8a1-4047-8895-c05f22a09c72 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:27.021689 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6d671ef1-a8a1-4047-8895-c05f22a09c72 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:27.048777 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-6d671ef1-a8a1-4047-8895-c05f22a09c72 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Going to try to terminate instance {{(pid=108970) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 04:42:27.159844 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-6d671ef1-a8a1-4047-8895-c05f22a09c72 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "DELETE /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 204 len: 0 microversion: 2.1 time: 0.150018 Aug 27 04:42:27.164145 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 599/1221] 10.222.0.53 () {58 vars in 1239 bytes} [Fri Aug 27 04:42:27 2021] DELETE /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 04:42:27.254914 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [req-7b3bef75-ecd8-404e-913b-80eb9bad7078 req-c7a7be91-2ccb-4f88-8221-7589733e0825 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2051c4e-353b-4875-8217-513125bcaf66", "tag": "236b6127-484d-477e-b8eb-9cc2f556a39e"}]} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:27.257145 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:42:27.257145 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: warnings.warn(msg) Aug 27 04:42:27.264035 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-7b3bef75-ecd8-404e-913b-80eb9bad7078 req-c7a7be91-2ccb-4f88-8221-7589733e0825 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:27.264490 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-7b3bef75-ecd8-404e-913b-80eb9bad7078 req-c7a7be91-2ccb-4f88-8221-7589733e0825 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:27.276085 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.compute.server_external_events [req-7b3bef75-ecd8-404e-913b-80eb9bad7078 req-c7a7be91-2ccb-4f88-8221-7589733e0825 service nova] Creating event network-changed:236b6127-484d-477e-b8eb-9cc2f556a39e for instance e2051c4e-353b-4875-8217-513125bcaf66 on hv-cinder-80403 Aug 27 04:42:27.281091 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [req-7b3bef75-ecd8-404e-913b-80eb9bad7078 req-c7a7be91-2ccb-4f88-8221-7589733e0825 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115479 Aug 27 04:42:27.282622 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 600/1222] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:42:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:42:27.286574 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-d7713202-8e8d-48f3-9055-84aecbe51d07 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:27.287283 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-d7713202-8e8d-48f3-9055-84aecbe51d07 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:27.293547 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d7713202-8e8d-48f3-9055-84aecbe51d07 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:27.294003 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d7713202-8e8d-48f3-9055-84aecbe51d07 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:27.294793 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d7713202-8e8d-48f3-9055-84aecbe51d07 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:27.295234 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d7713202-8e8d-48f3-9055-84aecbe51d07 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:27.438762 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-d7713202-8e8d-48f3-9055-84aecbe51d07 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:27.448492 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-d7713202-8e8d-48f3-9055-84aecbe51d07 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1567 microversion: 2.1 time: 0.165403 Aug 27 04:42:27.456564 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 601/1223] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:42:27 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:27.610363 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-53aea0bb-335a-486e-a3bf-7871bf90318e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:27.610982 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-53aea0bb-335a-486e-a3bf-7871bf90318e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:27.617832 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-53aea0bb-335a-486e-a3bf-7871bf90318e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:27.618297 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-53aea0bb-335a-486e-a3bf-7871bf90318e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:27.619125 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-53aea0bb-335a-486e-a3bf-7871bf90318e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:27.619652 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-53aea0bb-335a-486e-a3bf-7871bf90318e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:27.754259 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-53aea0bb-335a-486e-a3bf-7871bf90318e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:27.762691 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-53aea0bb-335a-486e-a3bf-7871bf90318e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:27.764680 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-53aea0bb-335a-486e-a3bf-7871bf90318e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:27.766042 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-53aea0bb-335a-486e-a3bf-7871bf90318e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1732 microversion: 2.20 time: 0.159447 Aug 27 04:42:27.767414 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 602/1224] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:42:27 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:42:28.466312 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-62713044-56f6-49b3-a54c-1fcee1ee2491 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:28.466975 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-62713044-56f6-49b3-a54c-1fcee1ee2491 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:28.472995 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-62713044-56f6-49b3-a54c-1fcee1ee2491 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:28.473441 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-62713044-56f6-49b3-a54c-1fcee1ee2491 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:28.474221 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-62713044-56f6-49b3-a54c-1fcee1ee2491 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:28.474666 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-62713044-56f6-49b3-a54c-1fcee1ee2491 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:28.612188 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-62713044-56f6-49b3-a54c-1fcee1ee2491 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:28.620577 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-62713044-56f6-49b3-a54c-1fcee1ee2491 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1567 microversion: 2.1 time: 0.157896 Aug 27 04:42:28.621364 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 603/1225] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:42:28 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:28.785094 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-0e6eb752-0a43-44c3-870b-da56f4ba2166 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:28.786047 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-0e6eb752-0a43-44c3-870b-da56f4ba2166 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:28.792385 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0e6eb752-0a43-44c3-870b-da56f4ba2166 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:28.792844 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0e6eb752-0a43-44c3-870b-da56f4ba2166 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:28.793631 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0e6eb752-0a43-44c3-870b-da56f4ba2166 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:28.794107 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0e6eb752-0a43-44c3-870b-da56f4ba2166 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:28.938633 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-0e6eb752-0a43-44c3-870b-da56f4ba2166 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:28.953338 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-0e6eb752-0a43-44c3-870b-da56f4ba2166 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:28.953338 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-0e6eb752-0a43-44c3-870b-da56f4ba2166 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:28.953876 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-0e6eb752-0a43-44c3-870b-da56f4ba2166 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1732 microversion: 2.20 time: 0.172088 Aug 27 04:42:28.974632 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 604/1226] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:42:28 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1732 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:42:29.649448 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-9a59311f-32f8-4c1e-ae98-88e06f597390 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:29.650099 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-9a59311f-32f8-4c1e-ae98-88e06f597390 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:29.656424 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9a59311f-32f8-4c1e-ae98-88e06f597390 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:29.657076 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9a59311f-32f8-4c1e-ae98-88e06f597390 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:29.658129 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9a59311f-32f8-4c1e-ae98-88e06f597390 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:29.658746 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9a59311f-32f8-4c1e-ae98-88e06f597390 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:29.829680 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-9a59311f-32f8-4c1e-ae98-88e06f597390 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:29.837854 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-9a59311f-32f8-4c1e-ae98-88e06f597390 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1567 microversion: 2.1 time: 0.192718 Aug 27 04:42:29.838432 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 605/1227] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:42:29 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1567 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:29.986624 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-09cb01ce-8ae7-4985-9fc6-8c4da239ed56 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:29.987838 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-09cb01ce-8ae7-4985-9fc6-8c4da239ed56 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:29.997556 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-09cb01ce-8ae7-4985-9fc6-8c4da239ed56 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:29.998282 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-09cb01ce-8ae7-4985-9fc6-8c4da239ed56 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:29.999555 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-09cb01ce-8ae7-4985-9fc6-8c4da239ed56 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:30.003610 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-09cb01ce-8ae7-4985-9fc6-8c4da239ed56 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:30.158500 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-09cb01ce-8ae7-4985-9fc6-8c4da239ed56 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:30.166861 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-09cb01ce-8ae7-4985-9fc6-8c4da239ed56 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:30.168334 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-09cb01ce-8ae7-4985-9fc6-8c4da239ed56 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:30.169484 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-09cb01ce-8ae7-4985-9fc6-8c4da239ed56 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1732 microversion: 2.20 time: 0.190279 Aug 27 04:42:30.170050 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 606/1228] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:42:29 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1732 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:42:30.855389 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-e41dd5a8-b5f1-4fa6-b1ae-d95411f9b5bd tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:30.856164 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-e41dd5a8-b5f1-4fa6-b1ae-d95411f9b5bd tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:30.862002 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e41dd5a8-b5f1-4fa6-b1ae-d95411f9b5bd tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:30.862459 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e41dd5a8-b5f1-4fa6-b1ae-d95411f9b5bd tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:30.863229 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e41dd5a8-b5f1-4fa6-b1ae-d95411f9b5bd tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:30.863670 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e41dd5a8-b5f1-4fa6-b1ae-d95411f9b5bd tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:30.994937 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-e41dd5a8-b5f1-4fa6-b1ae-d95411f9b5bd tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:31.002745 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-e41dd5a8-b5f1-4fa6-b1ae-d95411f9b5bd tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1567 microversion: 2.1 time: 0.151253 Aug 27 04:42:31.003328 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 607/1229] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:42:30 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:42:31.188071 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-bc6ab6fa-236b-41d0-be2c-4bae0b754db3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:31.188595 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-bc6ab6fa-236b-41d0-be2c-4bae0b754db3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:31.194671 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-bc6ab6fa-236b-41d0-be2c-4bae0b754db3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:31.195123 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-bc6ab6fa-236b-41d0-be2c-4bae0b754db3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:31.195914 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-bc6ab6fa-236b-41d0-be2c-4bae0b754db3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:31.196386 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-bc6ab6fa-236b-41d0-be2c-4bae0b754db3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:31.342363 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-bc6ab6fa-236b-41d0-be2c-4bae0b754db3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:31.362939 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-bc6ab6fa-236b-41d0-be2c-4bae0b754db3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:31.364512 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-bc6ab6fa-236b-41d0-be2c-4bae0b754db3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:31.365702 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-bc6ab6fa-236b-41d0-be2c-4bae0b754db3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1732 microversion: 2.20 time: 0.181498 Aug 27 04:42:31.377121 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 608/1230] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:42:31 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1732 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:42:32.018800 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-88f40a12-b257-40b5-896e-93c3b1aacc08 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:32.019401 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-88f40a12-b257-40b5-896e-93c3b1aacc08 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:32.026335 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-88f40a12-b257-40b5-896e-93c3b1aacc08 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:32.026781 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-88f40a12-b257-40b5-896e-93c3b1aacc08 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:32.027570 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-88f40a12-b257-40b5-896e-93c3b1aacc08 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:32.028073 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-88f40a12-b257-40b5-896e-93c3b1aacc08 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:32.182018 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-88f40a12-b257-40b5-896e-93c3b1aacc08 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:32.189996 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-88f40a12-b257-40b5-896e-93c3b1aacc08 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1567 microversion: 2.1 time: 0.174552 Aug 27 04:42:32.197671 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 609/1231] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:42:32 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:42:32.388426 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-144d0c35-4866-4bb1-8355-894be80f0027 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:32.389353 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-144d0c35-4866-4bb1-8355-894be80f0027 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:32.395932 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-144d0c35-4866-4bb1-8355-894be80f0027 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:32.396432 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-144d0c35-4866-4bb1-8355-894be80f0027 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:32.397210 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-144d0c35-4866-4bb1-8355-894be80f0027 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:32.397857 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-144d0c35-4866-4bb1-8355-894be80f0027 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:32.531973 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-144d0c35-4866-4bb1-8355-894be80f0027 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:32.540088 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-144d0c35-4866-4bb1-8355-894be80f0027 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:32.541614 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-144d0c35-4866-4bb1-8355-894be80f0027 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:32.542766 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-144d0c35-4866-4bb1-8355-894be80f0027 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1732 microversion: 2.20 time: 0.161311 Aug 27 04:42:32.543332 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 610/1232] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:42:32 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:42:33.206808 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-692a1323-daae-43cf-a89d-cefd333478dc tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:33.207587 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-692a1323-daae-43cf-a89d-cefd333478dc tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:33.214231 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-692a1323-daae-43cf-a89d-cefd333478dc tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:33.214685 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-692a1323-daae-43cf-a89d-cefd333478dc tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:33.215484 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-692a1323-daae-43cf-a89d-cefd333478dc tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:33.215924 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-692a1323-daae-43cf-a89d-cefd333478dc tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:33.351536 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-692a1323-daae-43cf-a89d-cefd333478dc tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:33.361593 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-692a1323-daae-43cf-a89d-cefd333478dc tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1567 microversion: 2.1 time: 0.158368 Aug 27 04:42:33.362173 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 611/1233] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:42:33 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:42:33.561252 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-9741bef9-7220-4eb9-a2c4-e596a04f904e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:33.561856 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-9741bef9-7220-4eb9-a2c4-e596a04f904e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:33.567802 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9741bef9-7220-4eb9-a2c4-e596a04f904e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:33.568275 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9741bef9-7220-4eb9-a2c4-e596a04f904e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:33.569535 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9741bef9-7220-4eb9-a2c4-e596a04f904e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:33.569974 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9741bef9-7220-4eb9-a2c4-e596a04f904e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:33.702151 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-9741bef9-7220-4eb9-a2c4-e596a04f904e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:33.710648 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-9741bef9-7220-4eb9-a2c4-e596a04f904e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:33.712167 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-9741bef9-7220-4eb9-a2c4-e596a04f904e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:33.713303 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-9741bef9-7220-4eb9-a2c4-e596a04f904e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1732 microversion: 2.20 time: 0.155813 Aug 27 04:42:33.713865 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 612/1234] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:42:33 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:42:34.378489 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-1416a51a-3711-4c25-90c9-23c78cf80034 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:34.379302 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-1416a51a-3711-4c25-90c9-23c78cf80034 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:34.385480 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1416a51a-3711-4c25-90c9-23c78cf80034 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:34.385960 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1416a51a-3711-4c25-90c9-23c78cf80034 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:34.386743 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1416a51a-3711-4c25-90c9-23c78cf80034 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:34.387181 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1416a51a-3711-4c25-90c9-23c78cf80034 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:34.522339 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-1416a51a-3711-4c25-90c9-23c78cf80034 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:34.529900 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-1416a51a-3711-4c25-90c9-23c78cf80034 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1567 microversion: 2.1 time: 0.155066 Aug 27 04:42:34.530484 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 613/1235] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:42:34 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:42:34.732370 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-4d9f879a-7565-4d40-821b-a33a39f23609 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:34.733020 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-4d9f879a-7565-4d40-821b-a33a39f23609 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:34.739653 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4d9f879a-7565-4d40-821b-a33a39f23609 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:34.740166 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4d9f879a-7565-4d40-821b-a33a39f23609 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:34.740969 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4d9f879a-7565-4d40-821b-a33a39f23609 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:34.741474 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4d9f879a-7565-4d40-821b-a33a39f23609 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:34.868162 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-4d9f879a-7565-4d40-821b-a33a39f23609 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:34.876287 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-4d9f879a-7565-4d40-821b-a33a39f23609 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:34.877790 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-4d9f879a-7565-4d40-821b-a33a39f23609 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:34.878947 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-4d9f879a-7565-4d40-821b-a33a39f23609 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1732 microversion: 2.20 time: 0.150742 Aug 27 04:42:34.879502 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 614/1236] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:42:34 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:42:35.548450 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-d7977c4a-5f49-4952-a96b-1a2e0a58b928 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:35.549150 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-d7977c4a-5f49-4952-a96b-1a2e0a58b928 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:35.555795 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d7977c4a-5f49-4952-a96b-1a2e0a58b928 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:35.556291 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d7977c4a-5f49-4952-a96b-1a2e0a58b928 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:35.557076 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d7977c4a-5f49-4952-a96b-1a2e0a58b928 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:35.557513 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d7977c4a-5f49-4952-a96b-1a2e0a58b928 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:35.690430 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-d7977c4a-5f49-4952-a96b-1a2e0a58b928 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:35.698708 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-d7977c4a-5f49-4952-a96b-1a2e0a58b928 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1567 microversion: 2.1 time: 0.154794 Aug 27 04:42:35.699289 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 615/1237] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:42:35 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:42:35.900443 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-dbcffc9e-237f-4edb-92f0-304a0c79b237 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:35.901436 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-dbcffc9e-237f-4edb-92f0-304a0c79b237 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:35.907647 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-dbcffc9e-237f-4edb-92f0-304a0c79b237 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:35.908115 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-dbcffc9e-237f-4edb-92f0-304a0c79b237 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:35.908884 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-dbcffc9e-237f-4edb-92f0-304a0c79b237 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:35.909315 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-dbcffc9e-237f-4edb-92f0-304a0c79b237 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:36.032895 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-dbcffc9e-237f-4edb-92f0-304a0c79b237 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:36.041524 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-dbcffc9e-237f-4edb-92f0-304a0c79b237 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:36.043015 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-dbcffc9e-237f-4edb-92f0-304a0c79b237 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:36.044187 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-dbcffc9e-237f-4edb-92f0-304a0c79b237 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1732 microversion: 2.20 time: 0.150511 Aug 27 04:42:36.044745 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 616/1238] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:42:35 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:42:36.716278 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-43195722-ae3a-401c-a6b0-406f757d8c44 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:36.716934 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-43195722-ae3a-401c-a6b0-406f757d8c44 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:36.722642 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-43195722-ae3a-401c-a6b0-406f757d8c44 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:36.723086 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-43195722-ae3a-401c-a6b0-406f757d8c44 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:36.723838 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-43195722-ae3a-401c-a6b0-406f757d8c44 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:36.724296 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-43195722-ae3a-401c-a6b0-406f757d8c44 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:36.848656 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-43195722-ae3a-401c-a6b0-406f757d8c44 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:36.859473 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-43195722-ae3a-401c-a6b0-406f757d8c44 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1567 microversion: 2.1 time: 0.146579 Aug 27 04:42:36.860440 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 617/1239] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:42:36 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:42:37.062699 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-5c8a20c0-b779-481a-bb75-2781fa015d7e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:37.063308 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-5c8a20c0-b779-481a-bb75-2781fa015d7e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:37.072214 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5c8a20c0-b779-481a-bb75-2781fa015d7e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:37.072675 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5c8a20c0-b779-481a-bb75-2781fa015d7e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:37.073465 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5c8a20c0-b779-481a-bb75-2781fa015d7e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:37.073904 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5c8a20c0-b779-481a-bb75-2781fa015d7e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:37.204791 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-5c8a20c0-b779-481a-bb75-2781fa015d7e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:37.212918 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-5c8a20c0-b779-481a-bb75-2781fa015d7e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:37.214432 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-5c8a20c0-b779-481a-bb75-2781fa015d7e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:37.215588 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-5c8a20c0-b779-481a-bb75-2781fa015d7e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1732 microversion: 2.20 time: 0.156688 Aug 27 04:42:37.216199 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 618/1240] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:42:37 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:42:37.764433 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-ac7504ff-2905-4f7e-b4da-85dbf5053a17 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 14.339736 Aug 27 04:42:37.765497 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 623/1241] 10.222.0.53 () {60 vars in 1323 bytes} [Fri Aug 27 04:42:23 2021] POST /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/os-volume_attachments => generated 194 bytes in 14342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:42:37.877273 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-e2ddf1f2-ebc5-41cf-8519-0af40179e226 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:37.877888 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-e2ddf1f2-ebc5-41cf-8519-0af40179e226 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:37.883809 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e2ddf1f2-ebc5-41cf-8519-0af40179e226 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:37.884288 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e2ddf1f2-ebc5-41cf-8519-0af40179e226 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:37.885054 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e2ddf1f2-ebc5-41cf-8519-0af40179e226 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:37.885492 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e2ddf1f2-ebc5-41cf-8519-0af40179e226 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:38.079064 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-e2ddf1f2-ebc5-41cf-8519-0af40179e226 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:38.087244 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-e2ddf1f2-ebc5-41cf-8519-0af40179e226 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1567 microversion: 2.1 time: 0.213698 Aug 27 04:42:38.088132 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 619/1242] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:42:37 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1567 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:38.235323 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-54ae3e7f-0723-4bf0-b975-18ccaf930953 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:38.236152 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-54ae3e7f-0723-4bf0-b975-18ccaf930953 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:38.243570 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-54ae3e7f-0723-4bf0-b975-18ccaf930953 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:38.244050 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-54ae3e7f-0723-4bf0-b975-18ccaf930953 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:38.244823 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-54ae3e7f-0723-4bf0-b975-18ccaf930953 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:38.245262 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-54ae3e7f-0723-4bf0-b975-18ccaf930953 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:38.370888 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-54ae3e7f-0723-4bf0-b975-18ccaf930953 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:38.388046 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-54ae3e7f-0723-4bf0-b975-18ccaf930953 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:38.389664 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-54ae3e7f-0723-4bf0-b975-18ccaf930953 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:38.390862 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-54ae3e7f-0723-4bf0-b975-18ccaf930953 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1732 microversion: 2.20 time: 0.159796 Aug 27 04:42:38.391370 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 624/1243] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:42:38 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:42:39.105221 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-4319ba7c-cc7e-4801-920f-d05fe8067da7 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:39.105770 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-4319ba7c-cc7e-4801-920f-d05fe8067da7 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:39.111646 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4319ba7c-cc7e-4801-920f-d05fe8067da7 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:39.112127 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4319ba7c-cc7e-4801-920f-d05fe8067da7 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:39.112902 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4319ba7c-cc7e-4801-920f-d05fe8067da7 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:39.113343 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-4319ba7c-cc7e-4801-920f-d05fe8067da7 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:39.235591 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-4319ba7c-cc7e-4801-920f-d05fe8067da7 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:39.243218 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-4319ba7c-cc7e-4801-920f-d05fe8067da7 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1449 microversion: 2.1 time: 0.142108 Aug 27 04:42:39.243801 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 620/1244] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:42:39 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1449 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:39.409511 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-665a2f85-de64-4ad7-ab9f-f84a5c50fd6c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:39.410116 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-665a2f85-de64-4ad7-ab9f-f84a5c50fd6c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:39.417117 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-665a2f85-de64-4ad7-ab9f-f84a5c50fd6c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:39.417560 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-665a2f85-de64-4ad7-ab9f-f84a5c50fd6c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:39.418331 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-665a2f85-de64-4ad7-ab9f-f84a5c50fd6c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:39.418784 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-665a2f85-de64-4ad7-ab9f-f84a5c50fd6c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:39.801701 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-665a2f85-de64-4ad7-ab9f-f84a5c50fd6c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:39.809665 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-665a2f85-de64-4ad7-ab9f-f84a5c50fd6c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:39.811203 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-665a2f85-de64-4ad7-ab9f-f84a5c50fd6c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:39.812360 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-665a2f85-de64-4ad7-ab9f-f84a5c50fd6c tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1732 microversion: 2.20 time: 0.406563 Aug 27 04:42:39.812914 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 625/1245] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:42:39 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1732 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:42:40.094124 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [req-76cb3d91-0291-4400-add9-dd4b735d00fb req-993f197f-7d88-44dc-8f97-20f22a691545 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2051c4e-353b-4875-8217-513125bcaf66", "name": "network-vif-deleted", "tag": "236b6127-484d-477e-b8eb-9cc2f556a39e"}]} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:40.096230 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:42:40.096230 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: warnings.warn(msg) Aug 27 04:42:40.103475 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-76cb3d91-0291-4400-add9-dd4b735d00fb req-993f197f-7d88-44dc-8f97-20f22a691545 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:40.103917 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-76cb3d91-0291-4400-add9-dd4b735d00fb req-993f197f-7d88-44dc-8f97-20f22a691545 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:40.114905 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.compute.server_external_events [req-76cb3d91-0291-4400-add9-dd4b735d00fb req-993f197f-7d88-44dc-8f97-20f22a691545 service nova] Creating event network-vif-deleted:236b6127-484d-477e-b8eb-9cc2f556a39e for instance e2051c4e-353b-4875-8217-513125bcaf66 on hv-cinder-80403 Aug 27 04:42:40.120249 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [req-76cb3d91-0291-4400-add9-dd4b735d00fb req-993f197f-7d88-44dc-8f97-20f22a691545 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029807 Aug 27 04:42:40.120871 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 621/1246] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:42:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:42:40.260089 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-a78c1821-c01e-4689-9cda-0c1f85e27a34 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:40.260609 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-a78c1821-c01e-4689-9cda-0c1f85e27a34 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:40.266468 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a78c1821-c01e-4689-9cda-0c1f85e27a34 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:40.266907 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a78c1821-c01e-4689-9cda-0c1f85e27a34 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:40.267655 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a78c1821-c01e-4689-9cda-0c1f85e27a34 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:40.268114 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a78c1821-c01e-4689-9cda-0c1f85e27a34 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:40.325844 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-a78c1821-c01e-4689-9cda-0c1f85e27a34 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74221dde8a0048af90dd03d8132aa68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c45e6a7cab4d2db5a499b8f2323e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:40.333018 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-a78c1821-c01e-4689-9cda-0c1f85e27a34 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 200 len: 1218 microversion: 2.1 time: 0.076649 Aug 27 04:42:40.333566 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 626/1247] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:42:40 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 1218 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:40.840616 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-058433e9-dff7-4133-bc78-be559e56de6a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:40.841284 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-058433e9-dff7-4133-bc78-be559e56de6a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:40.847591 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-058433e9-dff7-4133-bc78-be559e56de6a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:40.848088 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-058433e9-dff7-4133-bc78-be559e56de6a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:40.848697 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-058433e9-dff7-4133-bc78-be559e56de6a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:40.848697 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-058433e9-dff7-4133-bc78-be559e56de6a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:40.985510 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-058433e9-dff7-4133-bc78-be559e56de6a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:40.994161 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-058433e9-dff7-4133-bc78-be559e56de6a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:40.995685 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-058433e9-dff7-4133-bc78-be559e56de6a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:40.996973 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-058433e9-dff7-4133-bc78-be559e56de6a tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1732 microversion: 2.20 time: 0.162334 Aug 27 04:42:41.008012 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 622/1248] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:42:40 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:42:41.349360 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-89eec7f4-79ae-4392-90c8-c747852d1aea tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:41.349970 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-89eec7f4-79ae-4392-90c8-c747852d1aea tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] [instance: e2051c4e-353b-4875-8217-513125bcaf66] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:41.356430 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-89eec7f4-79ae-4392-90c8-c747852d1aea tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:41.356881 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-89eec7f4-79ae-4392-90c8-c747852d1aea tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:41.357658 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-89eec7f4-79ae-4392-90c8-c747852d1aea tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:41.358097 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-89eec7f4-79ae-4392-90c8-c747852d1aea tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:41.372306 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.wsgi [None req-89eec7f4-79ae-4392-90c8-c747852d1aea tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] HTTP exception thrown: Instance e2051c4e-353b-4875-8217-513125bcaf66 could not be found. Aug 27 04:42:41.372904 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-89eec7f4-79ae-4392-90c8-c747852d1aea tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Returning 404 to user: Instance e2051c4e-353b-4875-8217-513125bcaf66 could not be found. {{(pid=108971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:42:41.373870 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-89eec7f4-79ae-4392-90c8-c747852d1aea tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66" status: 404 len: 111 microversion: 2.1 time: 0.028396 Aug 27 04:42:41.374417 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 627/1249] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:42:41 2021] GET /compute/v2.1/servers/e2051c4e-353b-4875-8217-513125bcaf66 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:42:41.530960 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-e461d150-c3db-4659-a279-1cf4876a1ef6 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] Calling method '.version_select at 0x7f206bd15310>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:41.550325 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-e461d150-c3db-4659-a279-1cf4876a1ef6 tempest-TestShelveInstance-1383118860 tempest-TestShelveInstance-1383118860-project] 10.222.0.53 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-305484201" status: 202 len: 0 microversion: 2.1 time: 0.022984 Aug 27 04:42:41.550909 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 623/1250] 10.222.0.53 () {58 vars in 1251 bytes} [Fri Aug 27 04:42:41 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-305484201 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:42:42.016298 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-32c92bc5-ae10-4d7c-ac2d-6fef86d8222e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:42.016917 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-32c92bc5-ae10-4d7c-ac2d-6fef86d8222e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:42.024406 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-32c92bc5-ae10-4d7c-ac2d-6fef86d8222e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:42.026070 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-32c92bc5-ae10-4d7c-ac2d-6fef86d8222e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:42.026563 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-32c92bc5-ae10-4d7c-ac2d-6fef86d8222e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:42.027328 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-32c92bc5-ae10-4d7c-ac2d-6fef86d8222e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:42.230139 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-32c92bc5-ae10-4d7c-ac2d-6fef86d8222e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:42.238249 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-32c92bc5-ae10-4d7c-ac2d-6fef86d8222e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:42.239866 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-32c92bc5-ae10-4d7c-ac2d-6fef86d8222e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:42.241074 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-32c92bc5-ae10-4d7c-ac2d-6fef86d8222e tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1732 microversion: 2.20 time: 0.228577 Aug 27 04:42:42.251495 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 628/1251] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:42:42 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1732 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:42:43.114787 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [req-5a62b2a7-57ab-4383-a8af-8777fc9393e3 req-87af83b8-977d-451a-80cb-efc129afd3b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bbb8317-81d9-4e49-bd0b-32a4446ec505", "name": "network-vif-plugged", "status": "completed", "tag": "792a8fdf-832a-4455-8433-eb97d588eb8e"}]} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:43.120403 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:42:43.120403 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: warnings.warn(msg) Aug 27 04:42:43.131012 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-5a62b2a7-57ab-4383-a8af-8777fc9393e3 req-87af83b8-977d-451a-80cb-efc129afd3b3 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:43.132015 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-5a62b2a7-57ab-4383-a8af-8777fc9393e3 req-87af83b8-977d-451a-80cb-efc129afd3b3 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:43.145813 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.compute.server_external_events [req-5a62b2a7-57ab-4383-a8af-8777fc9393e3 req-87af83b8-977d-451a-80cb-efc129afd3b3 service nova] Creating event network-vif-plugged:792a8fdf-832a-4455-8433-eb97d588eb8e for instance 4bbb8317-81d9-4e49-bd0b-32a4446ec505 on hv-cinder-80403 Aug 27 04:42:43.151933 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [req-5a62b2a7-57ab-4383-a8af-8777fc9393e3 req-87af83b8-977d-451a-80cb-efc129afd3b3 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113258 Aug 27 04:42:43.153072 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 624/1252] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:42:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:42:43.259733 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-f16cd0c0-f371-4f50-9937-cc5025d0fb3f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:43.261385 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-f16cd0c0-f371-4f50-9937-cc5025d0fb3f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:43.267693 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f16cd0c0-f371-4f50-9937-cc5025d0fb3f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:43.268167 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f16cd0c0-f371-4f50-9937-cc5025d0fb3f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:43.268953 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f16cd0c0-f371-4f50-9937-cc5025d0fb3f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:43.269382 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f16cd0c0-f371-4f50-9937-cc5025d0fb3f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:43.677042 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-f16cd0c0-f371-4f50-9937-cc5025d0fb3f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:43.687906 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-f16cd0c0-f371-4f50-9937-cc5025d0fb3f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:43.689629 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-f16cd0c0-f371-4f50-9937-cc5025d0fb3f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:43.690799 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-f16cd0c0-f371-4f50-9937-cc5025d0fb3f tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1732 microversion: 2.20 time: 0.436008 Aug 27 04:42:43.691358 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 629/1253] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:42:43 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1732 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:42:44.711206 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-cf75de3a-d12e-4b1a-94f7-5a4dc7bf7941 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:44.712492 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-cf75de3a-d12e-4b1a-94f7-5a4dc7bf7941 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:44.718798 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-cf75de3a-d12e-4b1a-94f7-5a4dc7bf7941 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:44.719245 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-cf75de3a-d12e-4b1a-94f7-5a4dc7bf7941 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:44.720053 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-cf75de3a-d12e-4b1a-94f7-5a4dc7bf7941 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:44.720495 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-cf75de3a-d12e-4b1a-94f7-5a4dc7bf7941 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:44.851687 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-cf75de3a-d12e-4b1a-94f7-5a4dc7bf7941 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:44.859818 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-cf75de3a-d12e-4b1a-94f7-5a4dc7bf7941 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:44.861361 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-cf75de3a-d12e-4b1a-94f7-5a4dc7bf7941 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:44.862653 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-cf75de3a-d12e-4b1a-94f7-5a4dc7bf7941 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1732 microversion: 2.20 time: 0.155954 Aug 27 04:42:44.863063 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 625/1254] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:42:44 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:42:45.880658 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-c3d33ff5-e934-4936-98f2-c4289f7362b3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:45.881268 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-c3d33ff5-e934-4936-98f2-c4289f7362b3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:45.893777 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c3d33ff5-e934-4936-98f2-c4289f7362b3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:45.894584 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c3d33ff5-e934-4936-98f2-c4289f7362b3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:45.896032 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c3d33ff5-e934-4936-98f2-c4289f7362b3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:45.897359 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c3d33ff5-e934-4936-98f2-c4289f7362b3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:46.045902 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-c3d33ff5-e934-4936-98f2-c4289f7362b3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:46.063059 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-c3d33ff5-e934-4936-98f2-c4289f7362b3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:46.064669 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-c3d33ff5-e934-4936-98f2-c4289f7362b3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:46.065851 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-c3d33ff5-e934-4936-98f2-c4289f7362b3 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1732 microversion: 2.20 time: 0.189056 Aug 27 04:42:46.066606 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 630/1255] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:42:45 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1732 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:42:46.497661 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-f63ec08c-2b4f-4734-ad13-cad100320155 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:46.498784 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-f63ec08c-2b4f-4734-ad13-cad100320155 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:46.504773 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f63ec08c-2b4f-4734-ad13-cad100320155 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:46.505219 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f63ec08c-2b4f-4734-ad13-cad100320155 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:46.506467 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f63ec08c-2b4f-4734-ad13-cad100320155 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:46.506907 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f63ec08c-2b4f-4734-ad13-cad100320155 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:46.537754 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-f63ec08c-2b4f-4734-ad13-cad100320155 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043728 Aug 27 04:42:46.538324 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 626/1256] 10.222.0.53 () {58 vars in 1302 bytes} [Fri Aug 27 04:42:46 2021] GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:42:46.785989 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-b70c97f0-ccba-48f3-8ceb-7335cdcd9dcb tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:46.786473 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-b70c97f0-ccba-48f3-8ceb-7335cdcd9dcb tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:46.793059 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b70c97f0-ccba-48f3-8ceb-7335cdcd9dcb tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:46.793523 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b70c97f0-ccba-48f3-8ceb-7335cdcd9dcb tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:46.794306 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b70c97f0-ccba-48f3-8ceb-7335cdcd9dcb tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:46.794749 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b70c97f0-ccba-48f3-8ceb-7335cdcd9dcb tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:46.827513 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-b70c97f0-ccba-48f3-8ceb-7335cdcd9dcb tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/os-volume_attachments/dbf51ce0-a134-47d3-869a-842136a86b39" status: 200 len: 194 microversion: 2.1 time: 0.045213 Aug 27 04:42:46.832548 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 631/1257] 10.222.0.53 () {58 vars in 1413 bytes} [Fri Aug 27 04:42:46 2021] GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/os-volume_attachments/dbf51ce0-a134-47d3-869a-842136a86b39 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:42:46.837986 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-cdb13576-d881-464d-b795-f240a5d5cb3f tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:46.838856 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-cdb13576-d881-464d-b795-f240a5d5cb3f tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:46.845356 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-cdb13576-d881-464d-b795-f240a5d5cb3f tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:46.845931 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-cdb13576-d881-464d-b795-f240a5d5cb3f tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:46.846835 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-cdb13576-d881-464d-b795-f240a5d5cb3f tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:46.847378 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-cdb13576-d881-464d-b795-f240a5d5cb3f tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:46.941581 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.objects.instance [None req-cdb13576-d881-464d-b795-f240a5d5cb3f tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lazy-loading 'services' on Instance uuid d90eb911-b246-4928-ac32-cb9eb412ac05 {{(pid=108970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:42:47.009625 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-cdb13576-d881-464d-b795-f240a5d5cb3f tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "DELETE /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/os-volume_attachments/dbf51ce0-a134-47d3-869a-842136a86b39" status: 202 len: 0 microversion: 2.1 time: 0.174915 Aug 27 04:42:47.010241 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 627/1258] 10.222.0.53 () {58 vars in 1416 bytes} [Fri Aug 27 04:42:46 2021] DELETE /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/os-volume_attachments/dbf51ce0-a134-47d3-869a-842136a86b39 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:42:47.089850 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-53424258-a8bb-44fb-a165-0a5e01e136ca tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:47.090577 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-53424258-a8bb-44fb-a165-0a5e01e136ca tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:47.097931 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-53424258-a8bb-44fb-a165-0a5e01e136ca tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:47.098475 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-53424258-a8bb-44fb-a165-0a5e01e136ca tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:47.099694 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-53424258-a8bb-44fb-a165-0a5e01e136ca tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:47.100868 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-53424258-a8bb-44fb-a165-0a5e01e136ca tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:47.245808 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-53424258-a8bb-44fb-a165-0a5e01e136ca tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:47.253785 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-53424258-a8bb-44fb-a165-0a5e01e136ca tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:47.255269 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-53424258-a8bb-44fb-a165-0a5e01e136ca tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:47.256774 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-53424258-a8bb-44fb-a165-0a5e01e136ca tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1719 microversion: 2.20 time: 0.170644 Aug 27 04:42:47.257325 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 632/1259] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:42:47 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1719 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:42:49.204281 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-2887b125-bdff-4472-9328-75471e58ade5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:49.204883 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-2887b125-bdff-4472-9328-75471e58ade5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:49.211576 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2887b125-bdff-4472-9328-75471e58ade5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:49.212079 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2887b125-bdff-4472-9328-75471e58ade5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:49.215511 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2887b125-bdff-4472-9328-75471e58ade5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:49.216029 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2887b125-bdff-4472-9328-75471e58ade5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:49.247444 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-2887b125-bdff-4472-9328-75471e58ade5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/os-volume_attachments/ef665d7e-e00c-44cb-a8d0-e8bd4e0b4467" status: 200 len: 194 microversion: 2.1 time: 0.049252 Aug 27 04:42:49.248063 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 628/1260] 10.222.0.53 () {58 vars in 1413 bytes} [Fri Aug 27 04:42:49 2021] GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/os-volume_attachments/ef665d7e-e00c-44cb-a8d0-e8bd4e0b4467 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:42:49.257748 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-d38d788e-011d-4710-8b38-44fd228c7f7a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:49.258282 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-d38d788e-011d-4710-8b38-44fd228c7f7a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:49.264004 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d38d788e-011d-4710-8b38-44fd228c7f7a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:49.264654 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d38d788e-011d-4710-8b38-44fd228c7f7a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:49.265424 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d38d788e-011d-4710-8b38-44fd228c7f7a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:49.265852 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d38d788e-011d-4710-8b38-44fd228c7f7a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:49.347605 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.objects.instance [None req-d38d788e-011d-4710-8b38-44fd228c7f7a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lazy-loading 'services' on Instance uuid d90eb911-b246-4928-ac32-cb9eb412ac05 {{(pid=108971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:42:49.415200 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-d38d788e-011d-4710-8b38-44fd228c7f7a tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "DELETE /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/os-volume_attachments/ef665d7e-e00c-44cb-a8d0-e8bd4e0b4467" status: 202 len: 0 microversion: 2.1 time: 0.160980 Aug 27 04:42:49.416161 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 633/1261] 10.222.0.53 () {58 vars in 1416 bytes} [Fri Aug 27 04:42:49 2021] DELETE /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/os-volume_attachments/ef665d7e-e00c-44cb-a8d0-e8bd4e0b4467 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:42:50.582894 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-1240e578-900b-4918-bd66-d7a51f1df701 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:50.583855 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-1240e578-900b-4918-bd66-d7a51f1df701 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:50.590261 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1240e578-900b-4918-bd66-d7a51f1df701 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:50.590706 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1240e578-900b-4918-bd66-d7a51f1df701 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:50.591461 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1240e578-900b-4918-bd66-d7a51f1df701 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:50.592102 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1240e578-900b-4918-bd66-d7a51f1df701 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:50.621539 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-1240e578-900b-4918-bd66-d7a51f1df701 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042312 Aug 27 04:42:50.622094 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 629/1262] 10.222.0.53 () {58 vars in 1302 bytes} [Fri Aug 27 04:42:50 2021] GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:42:50.737659 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-81102dd0-37f3-46ff-bb21-2b8b64d3d542 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:50.738718 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-81102dd0-37f3-46ff-bb21-2b8b64d3d542 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:50.745152 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-81102dd0-37f3-46ff-bb21-2b8b64d3d542 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:50.745605 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-81102dd0-37f3-46ff-bb21-2b8b64d3d542 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:50.746373 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-81102dd0-37f3-46ff-bb21-2b8b64d3d542 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:50.746812 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-81102dd0-37f3-46ff-bb21-2b8b64d3d542 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:50.776717 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-81102dd0-37f3-46ff-bb21-2b8b64d3d542 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043076 Aug 27 04:42:50.777273 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 634/1263] 10.222.0.53 () {58 vars in 1302 bytes} [Fri Aug 27 04:42:50 2021] GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:42:50.838807 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-fa017475-8b7d-419c-acab-8717c5258082 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:50.839306 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-fa017475-8b7d-419c-acab-8717c5258082 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:50.845253 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fa017475-8b7d-419c-acab-8717c5258082 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:50.845711 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fa017475-8b7d-419c-acab-8717c5258082 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:50.846480 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fa017475-8b7d-419c-acab-8717c5258082 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:50.846919 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fa017475-8b7d-419c-acab-8717c5258082 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:50.871425 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-fa017475-8b7d-419c-acab-8717c5258082 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Going to try to terminate instance {{(pid=108970) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 04:42:50.944505 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-fa017475-8b7d-419c-acab-8717c5258082 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "DELETE /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05" status: 204 len: 0 microversion: 2.1 time: 0.109129 Aug 27 04:42:50.945104 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 630/1264] 10.222.0.53 () {58 vars in 1239 bytes} [Fri Aug 27 04:42:50 2021] DELETE /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:42:50.956996 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-49f249fe-97c4-4037-9342-ea561ea014e5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:50.958053 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-49f249fe-97c4-4037-9342-ea561ea014e5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:50.965112 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-49f249fe-97c4-4037-9342-ea561ea014e5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:50.965555 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-49f249fe-97c4-4037-9342-ea561ea014e5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:50.966334 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-49f249fe-97c4-4037-9342-ea561ea014e5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:50.966768 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-49f249fe-97c4-4037-9342-ea561ea014e5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:51.096658 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-49f249fe-97c4-4037-9342-ea561ea014e5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:51.104015 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-49f249fe-97c4-4037-9342-ea561ea014e5 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05" status: 200 len: 1673 microversion: 2.1 time: 0.153923 Aug 27 04:42:51.104848 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 635/1265] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:42:50 2021] GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05 => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:52.122190 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-922a8c1f-76ce-4968-ab92-f68a47dafb82 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:52.122928 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-922a8c1f-76ce-4968-ab92-f68a47dafb82 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:52.128994 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-922a8c1f-76ce-4968-ab92-f68a47dafb82 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:52.129486 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-922a8c1f-76ce-4968-ab92-f68a47dafb82 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:52.130284 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-922a8c1f-76ce-4968-ab92-f68a47dafb82 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:52.130728 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-922a8c1f-76ce-4968-ab92-f68a47dafb82 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:52.262801 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-922a8c1f-76ce-4968-ab92-f68a47dafb82 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:52.270978 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-922a8c1f-76ce-4968-ab92-f68a47dafb82 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05" status: 200 len: 1673 microversion: 2.1 time: 0.152802 Aug 27 04:42:52.271610 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 631/1266] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:42:52 2021] GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05 => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:53.289503 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-51febd30-7f8c-475d-aed3-691bd154519d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:53.290111 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-51febd30-7f8c-475d-aed3-691bd154519d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:53.296040 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-51febd30-7f8c-475d-aed3-691bd154519d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:53.296490 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-51febd30-7f8c-475d-aed3-691bd154519d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:53.297262 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-51febd30-7f8c-475d-aed3-691bd154519d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:53.297696 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-51febd30-7f8c-475d-aed3-691bd154519d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:53.503700 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-51febd30-7f8c-475d-aed3-691bd154519d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:53.511286 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-51febd30-7f8c-475d-aed3-691bd154519d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05" status: 200 len: 1673 microversion: 2.1 time: 0.226029 Aug 27 04:42:53.511858 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 636/1267] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:42:53 2021] GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05 => generated 1673 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:42:54.149546 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [req-541e6d8d-f979-417a-b2e3-133ae65ee3ed req-f9e32683-5243-4611-b4be-86956a0436df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d90eb911-b246-4928-ac32-cb9eb412ac05", "name": "network-vif-deleted", "tag": "be02021d-efc7-490f-b112-ba663b0a0f36"}]} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:42:54.151071 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:42:54.151071 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: warnings.warn(msg) Aug 27 04:42:54.164231 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-541e6d8d-f979-417a-b2e3-133ae65ee3ed req-f9e32683-5243-4611-b4be-86956a0436df service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:54.164681 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-541e6d8d-f979-417a-b2e3-133ae65ee3ed req-f9e32683-5243-4611-b4be-86956a0436df service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:54.177299 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.compute.server_external_events [req-541e6d8d-f979-417a-b2e3-133ae65ee3ed req-f9e32683-5243-4611-b4be-86956a0436df service nova] Creating event network-vif-deleted:be02021d-efc7-490f-b112-ba663b0a0f36 for instance d90eb911-b246-4928-ac32-cb9eb412ac05 on hv-cinder-80403 Aug 27 04:42:54.183023 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [req-541e6d8d-f979-417a-b2e3-133ae65ee3ed req-f9e32683-5243-4611-b4be-86956a0436df service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037030 Aug 27 04:42:54.183667 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 632/1268] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:42:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:42:54.528344 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-4b114dc6-19f2-4fdc-99d5-752d1b8644ed tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:54.528957 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-4b114dc6-19f2-4fdc-99d5-752d1b8644ed tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:54.535472 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-4b114dc6-19f2-4fdc-99d5-752d1b8644ed tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:54.535916 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-4b114dc6-19f2-4fdc-99d5-752d1b8644ed tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:54.536798 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-4b114dc6-19f2-4fdc-99d5-752d1b8644ed tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:54.537801 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-4b114dc6-19f2-4fdc-99d5-752d1b8644ed tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:54.572079 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-4b114dc6-19f2-4fdc-99d5-752d1b8644ed tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:54.572535 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-4b114dc6-19f2-4fdc-99d5-752d1b8644ed tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:54.572996 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.objects.instance [None req-4b114dc6-19f2-4fdc-99d5-752d1b8644ed tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lazy-loading 'fault' on Instance uuid d90eb911-b246-4928-ac32-cb9eb412ac05 {{(pid=108971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:42:54.618018 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-4b114dc6-19f2-4fdc-99d5-752d1b8644ed tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54782c38800c424ca31457987a9d771b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73010213c0b945979b5a337586b82752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:42:54.626104 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-4b114dc6-19f2-4fdc-99d5-752d1b8644ed tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05" status: 200 len: 1328 microversion: 2.1 time: 0.101390 Aug 27 04:42:54.626926 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 637/1269] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:42:54 2021] GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05 => generated 1328 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:42:55.644223 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-03e8c462-10ee-470d-a037-b4e6ab084068 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:55.645560 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-03e8c462-10ee-470d-a037-b4e6ab084068 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:55.651829 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-03e8c462-10ee-470d-a037-b4e6ab084068 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:55.652310 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-03e8c462-10ee-470d-a037-b4e6ab084068 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:55.653083 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-03e8c462-10ee-470d-a037-b4e6ab084068 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:55.653519 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-03e8c462-10ee-470d-a037-b4e6ab084068 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:55.666632 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.wsgi [None req-03e8c462-10ee-470d-a037-b4e6ab084068 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] HTTP exception thrown: Instance d90eb911-b246-4928-ac32-cb9eb412ac05 could not be found. Aug 27 04:42:55.667249 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-03e8c462-10ee-470d-a037-b4e6ab084068 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Returning 404 to user: Instance d90eb911-b246-4928-ac32-cb9eb412ac05 could not be found. {{(pid=108970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:42:55.668131 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-03e8c462-10ee-470d-a037-b4e6ab084068 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05" status: 404 len: 111 microversion: 2.1 time: 0.027986 Aug 27 04:42:55.668662 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 633/1270] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:42:55 2021] GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 04:42:55.676840 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-f42e872e-bee8-4627-8c63-cbfa483f4f98 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '.version_select at 0x7f20786b0550>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:55.699336 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-f42e872e-bee8-4627-8c63-cbfa483f4f98 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1473639690" status: 202 len: 0 microversion: 2.1 time: 0.026104 Aug 27 04:42:55.700227 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 638/1271] 10.222.0.53 () {58 vars in 1221 bytes} [Fri Aug 27 04:42:55 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1473639690 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:42:58.851799 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-3b457f62-2a2d-4e14-8e18-9e2f99825e25 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:58.852556 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-3b457f62-2a2d-4e14-8e18-9e2f99825e25 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:58.858536 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3b457f62-2a2d-4e14-8e18-9e2f99825e25 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:58.858992 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3b457f62-2a2d-4e14-8e18-9e2f99825e25 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:58.859776 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3b457f62-2a2d-4e14-8e18-9e2f99825e25 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:58.860253 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3b457f62-2a2d-4e14-8e18-9e2f99825e25 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:58.876804 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.wsgi [None req-3b457f62-2a2d-4e14-8e18-9e2f99825e25 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] HTTP exception thrown: Instance d90eb911-b246-4928-ac32-cb9eb412ac05 could not be found. Aug 27 04:42:58.877388 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-3b457f62-2a2d-4e14-8e18-9e2f99825e25 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Returning 404 to user: Instance d90eb911-b246-4928-ac32-cb9eb412ac05 could not be found. {{(pid=108970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:42:58.878209 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-3b457f62-2a2d-4e14-8e18-9e2f99825e25 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "DELETE /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05" status: 404 len: 111 microversion: 2.1 time: 0.030145 Aug 27 04:42:58.878756 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 634/1272] 10.222.0.53 () {58 vars in 1239 bytes} [Fri Aug 27 04:42:58 2021] DELETE /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:42:58.887538 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-37b5518c-9b82-4651-bb4b-f84f1f4c28da tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:42:58.888198 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-37b5518c-9b82-4651-bb4b-f84f1f4c28da tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: d90eb911-b246-4928-ac32-cb9eb412ac05] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:42:58.894063 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-37b5518c-9b82-4651-bb4b-f84f1f4c28da tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:58.894508 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-37b5518c-9b82-4651-bb4b-f84f1f4c28da tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:58.895278 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-37b5518c-9b82-4651-bb4b-f84f1f4c28da tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:42:58.895715 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-37b5518c-9b82-4651-bb4b-f84f1f4c28da tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:42:58.909027 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.wsgi [None req-37b5518c-9b82-4651-bb4b-f84f1f4c28da tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] HTTP exception thrown: Instance d90eb911-b246-4928-ac32-cb9eb412ac05 could not be found. Aug 27 04:42:58.909622 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-37b5518c-9b82-4651-bb4b-f84f1f4c28da tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Returning 404 to user: Instance d90eb911-b246-4928-ac32-cb9eb412ac05 could not be found. {{(pid=108971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:42:58.910453 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-37b5518c-9b82-4651-bb4b-f84f1f4c28da tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05" status: 404 len: 111 microversion: 2.1 time: 0.026897 Aug 27 04:42:58.910990 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 639/1273] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:42:58 2021] GET /compute/v2.1/servers/d90eb911-b246-4928-ac32-cb9eb412ac05 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:43:00.041650 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-a377dc84-af4b-46d5-8920-91be1921cc4d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:00.042155 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-a377dc84-af4b-46d5-8920-91be1921cc4d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:43:00.048145 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a377dc84-af4b-46d5-8920-91be1921cc4d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:43:00.048600 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a377dc84-af4b-46d5-8920-91be1921cc4d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:43:00.049373 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a377dc84-af4b-46d5-8920-91be1921cc4d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:43:00.049818 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a377dc84-af4b-46d5-8920-91be1921cc4d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:43:00.062602 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.wsgi [None req-a377dc84-af4b-46d5-8920-91be1921cc4d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] HTTP exception thrown: Instance 5598e9e1-bc44-4831-be1a-f478deba899b could not be found. Aug 27 04:43:00.063185 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-a377dc84-af4b-46d5-8920-91be1921cc4d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Returning 404 to user: Instance 5598e9e1-bc44-4831-be1a-f478deba899b could not be found. {{(pid=108970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:43:00.064026 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-a377dc84-af4b-46d5-8920-91be1921cc4d tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "DELETE /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 404 len: 111 microversion: 2.1 time: 0.026045 Aug 27 04:43:00.064543 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 635/1274] 10.222.0.53 () {58 vars in 1239 bytes} [Fri Aug 27 04:43:00 2021] DELETE /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:43:00.072684 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-a9924b8e-1458-472c-ab5b-a4ab9a02ddc6 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:00.073342 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-a9924b8e-1458-472c-ab5b-a4ab9a02ddc6 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] [instance: 5598e9e1-bc44-4831-be1a-f478deba899b] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:43:00.079214 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a9924b8e-1458-472c-ab5b-a4ab9a02ddc6 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:43:00.079657 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a9924b8e-1458-472c-ab5b-a4ab9a02ddc6 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:43:00.080439 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a9924b8e-1458-472c-ab5b-a4ab9a02ddc6 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:43:00.080869 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a9924b8e-1458-472c-ab5b-a4ab9a02ddc6 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:43:00.094157 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.wsgi [None req-a9924b8e-1458-472c-ab5b-a4ab9a02ddc6 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] HTTP exception thrown: Instance 5598e9e1-bc44-4831-be1a-f478deba899b could not be found. Aug 27 04:43:00.094724 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-a9924b8e-1458-472c-ab5b-a4ab9a02ddc6 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] Returning 404 to user: Instance 5598e9e1-bc44-4831-be1a-f478deba899b could not be found. {{(pid=108971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:43:00.095516 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-a9924b8e-1458-472c-ab5b-a4ab9a02ddc6 tempest-AttachVolumeTestJSON-1339833358 tempest-AttachVolumeTestJSON-1339833358-project] 10.222.0.53 "GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b" status: 404 len: 111 microversion: 2.1 time: 0.026979 Aug 27 04:43:00.096034 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 640/1275] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:43:00 2021] GET /compute/v2.1/servers/5598e9e1-bc44-4831-be1a-f478deba899b => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:43:04.580237 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-d7c68ff3-9d65-47f0-ba25-cb6cd7990d6d tempest-VolumesGetTestJSON-1484209515 tempest-VolumesGetTestJSON-1484209515-project] Action: 'create', calling method: .version_select at 0x7f206bc9e700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-534875760", "metadata": {"Type": "work"}}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:43:04.861417 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-d7c68ff3-9d65-47f0-ba25-cb6cd7990d6d tempest-VolumesGetTestJSON-1484209515 tempest-VolumesGetTestJSON-1484209515-project] 10.222.0.53 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.397545 Aug 27 04:43:04.862031 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 636/1276] 10.222.0.53 () {60 vars in 1156 bytes} [Fri Aug 27 04:43:04 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 399 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 27 04:43:04.873235 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-89fed1a4-b919-4bc8-8f41-7eeea9bfc1da tempest-VolumesGetTestJSON-1484209515 tempest-VolumesGetTestJSON-1484209515-project] Calling method '.version_select at 0x7f20785183a0>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:04.925509 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-89fed1a4-b919-4bc8-8f41-7eeea9bfc1da tempest-VolumesGetTestJSON-1484209515 tempest-VolumesGetTestJSON-1484209515-project] 10.222.0.53 "GET /compute/v2.1/os-volumes/0cbc97fd-4533-4c8a-9dfd-a231be633745" status: 200 len: 352 microversion: 2.1 time: 0.055900 Aug 27 04:43:04.926069 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 641/1277] 10.222.0.53 () {58 vars in 1245 bytes} [Fri Aug 27 04:43:04 2021] GET /compute/v2.1/os-volumes/0cbc97fd-4533-4c8a-9dfd-a231be633745 => generated 352 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:43:05.938291 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-e859c661-8ab5-4c75-8a56-b0a6fd1eed1a tempest-VolumesGetTestJSON-1484209515 tempest-VolumesGetTestJSON-1484209515-project] Calling method '.version_select at 0x7f206bc4f310>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:05.988119 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-e859c661-8ab5-4c75-8a56-b0a6fd1eed1a tempest-VolumesGetTestJSON-1484209515 tempest-VolumesGetTestJSON-1484209515-project] 10.222.0.53 "GET /compute/v2.1/os-volumes/0cbc97fd-4533-4c8a-9dfd-a231be633745" status: 200 len: 353 microversion: 2.1 time: 0.053414 Aug 27 04:43:05.988776 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 637/1278] 10.222.0.53 () {58 vars in 1245 bytes} [Fri Aug 27 04:43:05 2021] GET /compute/v2.1/os-volumes/0cbc97fd-4533-4c8a-9dfd-a231be633745 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:43:05.999384 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-d7d548f3-94f4-4ead-b47c-3f10470bc62f tempest-VolumesGetTestJSON-1484209515 tempest-VolumesGetTestJSON-1484209515-project] Calling method '.version_select at 0x7f20785cd820>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:06.049396 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-d7d548f3-94f4-4ead-b47c-3f10470bc62f tempest-VolumesGetTestJSON-1484209515 tempest-VolumesGetTestJSON-1484209515-project] 10.222.0.53 "GET /compute/v2.1/os-volumes/0cbc97fd-4533-4c8a-9dfd-a231be633745" status: 200 len: 353 microversion: 2.1 time: 0.053469 Aug 27 04:43:06.049952 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 642/1279] 10.222.0.53 () {58 vars in 1245 bytes} [Fri Aug 27 04:43:05 2021] GET /compute/v2.1/os-volumes/0cbc97fd-4533-4c8a-9dfd-a231be633745 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:43:06.065220 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-6af284d6-5bfe-4260-9092-a20353f7f1d6 tempest-VolumesGetTestJSON-1484209515 tempest-VolumesGetTestJSON-1484209515-project] Calling method '.version_select at 0x7f206bd15430>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:06.122719 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-6af284d6-5bfe-4260-9092-a20353f7f1d6 tempest-VolumesGetTestJSON-1484209515 tempest-VolumesGetTestJSON-1484209515-project] 10.222.0.53 "DELETE /compute/v2.1/os-volumes/0cbc97fd-4533-4c8a-9dfd-a231be633745" status: 202 len: 0 microversion: 2.1 time: 0.061003 Aug 27 04:43:06.123288 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 638/1280] 10.222.0.53 () {58 vars in 1248 bytes} [Fri Aug 27 04:43:06 2021] DELETE /compute/v2.1/os-volumes/0cbc97fd-4533-4c8a-9dfd-a231be633745 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:43:06.131819 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-e601d4d9-8633-4e72-a1e3-f473ca9b7b97 tempest-VolumesGetTestJSON-1484209515 tempest-VolumesGetTestJSON-1484209515-project] Calling method '.version_select at 0x7f20786b0160>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:06.182586 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-e601d4d9-8633-4e72-a1e3-f473ca9b7b97 tempest-VolumesGetTestJSON-1484209515 tempest-VolumesGetTestJSON-1484209515-project] 10.222.0.53 "GET /compute/v2.1/os-volumes/0cbc97fd-4533-4c8a-9dfd-a231be633745" status: 200 len: 352 microversion: 2.1 time: 0.054876 Aug 27 04:43:06.183169 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 643/1281] 10.222.0.53 () {58 vars in 1245 bytes} [Fri Aug 27 04:43:06 2021] GET /compute/v2.1/os-volumes/0cbc97fd-4533-4c8a-9dfd-a231be633745 => generated 352 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:43:07.194849 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-b8bb86d8-225e-40f6-8bf6-687659cc2448 tempest-VolumesGetTestJSON-1484209515 tempest-VolumesGetTestJSON-1484209515-project] Calling method '.version_select at 0x7f206bd15700>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:43:07.221021 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.wsgi [None req-b8bb86d8-225e-40f6-8bf6-687659cc2448 tempest-VolumesGetTestJSON-1484209515 tempest-VolumesGetTestJSON-1484209515-project] HTTP exception thrown: Volume 0cbc97fd-4533-4c8a-9dfd-a231be633745 could not be found. Aug 27 04:43:07.221616 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-b8bb86d8-225e-40f6-8bf6-687659cc2448 tempest-VolumesGetTestJSON-1484209515 tempest-VolumesGetTestJSON-1484209515-project] Returning 404 to user: Volume 0cbc97fd-4533-4c8a-9dfd-a231be633745 could not be found. {{(pid=108970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:43:07.222436 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-b8bb86d8-225e-40f6-8bf6-687659cc2448 tempest-VolumesGetTestJSON-1484209515 tempest-VolumesGetTestJSON-1484209515-project] 10.222.0.53 "GET /compute/v2.1/os-volumes/0cbc97fd-4533-4c8a-9dfd-a231be633745" status: 404 len: 109 microversion: 2.1 time: 0.031360 Aug 27 04:43:07.222970 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 639/1282] 10.222.0.53 () {58 vars in 1245 bytes} [Fri Aug 27 04:43:07 2021] GET /compute/v2.1/os-volumes/0cbc97fd-4533-4c8a-9dfd-a231be633745 => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:44:14.394717 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-5e34f715-adf6-4a03-bebf-4f7b2acb0c3d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:14.395611 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-5e34f715-adf6-4a03-bebf-4f7b2acb0c3d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:44:14.401565 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5e34f715-adf6-4a03-bebf-4f7b2acb0c3d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:14.402007 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5e34f715-adf6-4a03-bebf-4f7b2acb0c3d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:14.402833 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5e34f715-adf6-4a03-bebf-4f7b2acb0c3d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:14.403472 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5e34f715-adf6-4a03-bebf-4f7b2acb0c3d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:14.433239 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-5e34f715-adf6-4a03-bebf-4f7b2acb0c3d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043606 Aug 27 04:44:14.433811 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 644/1283] 10.222.0.53 () {60 vars in 1343 bytes} [Fri Aug 27 04:44:14 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:44:14.499243 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-bf61b877-a0b6-4a62-b961-531a0e5870a9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:14.500279 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-bf61b877-a0b6-4a62-b961-531a0e5870a9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:44:14.507198 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-bf61b877-a0b6-4a62-b961-531a0e5870a9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:14.507642 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-bf61b877-a0b6-4a62-b961-531a0e5870a9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:14.508436 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-bf61b877-a0b6-4a62-b961-531a0e5870a9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:14.508870 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-bf61b877-a0b6-4a62-b961-531a0e5870a9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:14.533823 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-bf61b877-a0b6-4a62-b961-531a0e5870a9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Going to try to terminate instance {{(pid=108970) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 04:44:14.612302 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-bf61b877-a0b6-4a62-b961-531a0e5870a9 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "DELETE /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 204 len: 0 microversion: 2.20 time: 0.118147 Aug 27 04:44:14.612784 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 640/1284] 10.222.0.53 () {60 vars in 1280 bytes} [Fri Aug 27 04:44:14 2021] DELETE /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 04:44:14.621493 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-4088ab6b-e9e8-4263-bfd9-6cc3c1d6889d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:14.622289 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-4088ab6b-e9e8-4263-bfd9-6cc3c1d6889d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:44:14.628311 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-4088ab6b-e9e8-4263-bfd9-6cc3c1d6889d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:14.628753 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-4088ab6b-e9e8-4263-bfd9-6cc3c1d6889d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:14.629693 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-4088ab6b-e9e8-4263-bfd9-6cc3c1d6889d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:14.630127 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-4088ab6b-e9e8-4263-bfd9-6cc3c1d6889d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:14.762262 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-4088ab6b-e9e8-4263-bfd9-6cc3c1d6889d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:14.770205 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-4088ab6b-e9e8-4263-bfd9-6cc3c1d6889d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:14.771733 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-4088ab6b-e9e8-4263-bfd9-6cc3c1d6889d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:14.772912 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-4088ab6b-e9e8-4263-bfd9-6cc3c1d6889d tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1725 microversion: 2.20 time: 0.155166 Aug 27 04:44:14.773460 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 645/1285] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:44:14 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:44:15.799111 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-64f4dd03-635d-41da-9f89-6cc50865ace5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:15.799841 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-64f4dd03-635d-41da-9f89-6cc50865ace5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:44:15.806647 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-64f4dd03-635d-41da-9f89-6cc50865ace5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:15.807102 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-64f4dd03-635d-41da-9f89-6cc50865ace5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:15.807891 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-64f4dd03-635d-41da-9f89-6cc50865ace5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:15.808371 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-64f4dd03-635d-41da-9f89-6cc50865ace5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:15.931028 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-64f4dd03-635d-41da-9f89-6cc50865ace5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:15.938926 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-64f4dd03-635d-41da-9f89-6cc50865ace5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:15.940464 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-64f4dd03-635d-41da-9f89-6cc50865ace5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:15.941622 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-64f4dd03-635d-41da-9f89-6cc50865ace5 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1725 microversion: 2.20 time: 0.146656 Aug 27 04:44:15.942186 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 641/1286] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:44:15 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:44:16.961001 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-09d6a5bb-dbc3-4661-a56a-884308c23b43 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:16.961618 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-09d6a5bb-dbc3-4661-a56a-884308c23b43 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:44:16.967966 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-09d6a5bb-dbc3-4661-a56a-884308c23b43 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:16.968444 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-09d6a5bb-dbc3-4661-a56a-884308c23b43 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:16.969442 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-09d6a5bb-dbc3-4661-a56a-884308c23b43 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:16.969904 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-09d6a5bb-dbc3-4661-a56a-884308c23b43 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:17.230255 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-09d6a5bb-dbc3-4661-a56a-884308c23b43 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:17.251614 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-09d6a5bb-dbc3-4661-a56a-884308c23b43 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:17.253154 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-09d6a5bb-dbc3-4661-a56a-884308c23b43 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebedf95669444aa29994308a5f59ee2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6be58896fed46208a356cedf5a8513e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:17.254435 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-09d6a5bb-dbc3-4661-a56a-884308c23b43 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 200 len: 1725 microversion: 2.20 time: 0.297802 Aug 27 04:44:17.255021 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 646/1287] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:44:16 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 1725 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:44:17.645529 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [req-a58f6a03-263a-4a5e-a9db-ea980aff160f req-ef374a9e-c32a-414b-81eb-df3cbb7aea10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bbb8317-81d9-4e49-bd0b-32a4446ec505", "name": "network-vif-deleted", "tag": "792a8fdf-832a-4455-8433-eb97d588eb8e"}]} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:44:17.647201 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:44:17.647201 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: warnings.warn(msg) Aug 27 04:44:17.654531 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-a58f6a03-263a-4a5e-a9db-ea980aff160f req-ef374a9e-c32a-414b-81eb-df3cbb7aea10 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:17.655030 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-a58f6a03-263a-4a5e-a9db-ea980aff160f req-ef374a9e-c32a-414b-81eb-df3cbb7aea10 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:17.667877 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.compute.server_external_events [req-a58f6a03-263a-4a5e-a9db-ea980aff160f req-ef374a9e-c32a-414b-81eb-df3cbb7aea10 service nova] Creating event network-vif-deleted:792a8fdf-832a-4455-8433-eb97d588eb8e for instance 4bbb8317-81d9-4e49-bd0b-32a4446ec505 on hv-cinder-80403 Aug 27 04:44:17.673360 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [req-a58f6a03-263a-4a5e-a9db-ea980aff160f req-ef374a9e-c32a-414b-81eb-df3cbb7aea10 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032011 Aug 27 04:44:17.674276 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 642/1288] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:44:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:44:18.274532 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-6312fa68-63e4-4be4-987a-b68bf3c527e0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:18.275417 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-6312fa68-63e4-4be4-987a-b68bf3c527e0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:44:18.289175 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6312fa68-63e4-4be4-987a-b68bf3c527e0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:18.290248 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6312fa68-63e4-4be4-987a-b68bf3c527e0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:18.293097 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6312fa68-63e4-4be4-987a-b68bf3c527e0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:18.294040 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6312fa68-63e4-4be4-987a-b68bf3c527e0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:18.308993 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.wsgi [None req-6312fa68-63e4-4be4-987a-b68bf3c527e0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] HTTP exception thrown: Instance 4bbb8317-81d9-4e49-bd0b-32a4446ec505 could not be found. Aug 27 04:44:18.309574 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-6312fa68-63e4-4be4-987a-b68bf3c527e0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Returning 404 to user: Instance 4bbb8317-81d9-4e49-bd0b-32a4446ec505 could not be found. {{(pid=108971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:44:18.310670 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-6312fa68-63e4-4be4-987a-b68bf3c527e0 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 404 len: 111 microversion: 2.20 time: 0.039861 Aug 27 04:44:18.311440 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 647/1289] 10.222.0.53 () {60 vars in 1277 bytes} [Fri Aug 27 04:44:18 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:44:18.321851 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-d062ae19-b01b-469c-9702-82b5462b8d76 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '.version_select at 0x7f206bcd73a0>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:18.343025 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-d062ae19-b01b-469c-9702-82b5462b8d76 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1791509285" status: 204 len: 0 microversion: 2.20 time: 0.025624 Aug 27 04:44:18.344331 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 643/1290] 10.222.0.53 () {60 vars in 1262 bytes} [Fri Aug 27 04:44:18 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1791509285 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 04:44:20.656452 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-3aa87fb4-f28b-4dd6-aef0-a47d1c0d6b82 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:20.657008 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-3aa87fb4-f28b-4dd6-aef0-a47d1c0d6b82 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:44:20.664900 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3aa87fb4-f28b-4dd6-aef0-a47d1c0d6b82 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:20.665805 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3aa87fb4-f28b-4dd6-aef0-a47d1c0d6b82 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:20.667251 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3aa87fb4-f28b-4dd6-aef0-a47d1c0d6b82 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:20.668036 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3aa87fb4-f28b-4dd6-aef0-a47d1c0d6b82 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:20.690916 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.wsgi [None req-3aa87fb4-f28b-4dd6-aef0-a47d1c0d6b82 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] HTTP exception thrown: Instance 4bbb8317-81d9-4e49-bd0b-32a4446ec505 could not be found. Aug 27 04:44:20.691519 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-3aa87fb4-f28b-4dd6-aef0-a47d1c0d6b82 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Returning 404 to user: Instance 4bbb8317-81d9-4e49-bd0b-32a4446ec505 could not be found. {{(pid=108971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:44:20.692378 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-3aa87fb4-f28b-4dd6-aef0-a47d1c0d6b82 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "DELETE /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 404 len: 111 microversion: 2.1 time: 0.039737 Aug 27 04:44:20.692935 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 648/1291] 10.222.0.53 () {58 vars in 1239 bytes} [Fri Aug 27 04:44:20 2021] DELETE /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:44:20.702647 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-cca78d9e-cf25-4e3c-aab4-1fd638554638 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:20.703842 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-cca78d9e-cf25-4e3c-aab4-1fd638554638 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: 4bbb8317-81d9-4e49-bd0b-32a4446ec505] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:44:20.713239 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-cca78d9e-cf25-4e3c-aab4-1fd638554638 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:20.713686 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-cca78d9e-cf25-4e3c-aab4-1fd638554638 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:20.714468 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-cca78d9e-cf25-4e3c-aab4-1fd638554638 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:20.714902 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-cca78d9e-cf25-4e3c-aab4-1fd638554638 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:20.730160 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.wsgi [None req-cca78d9e-cf25-4e3c-aab4-1fd638554638 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] HTTP exception thrown: Instance 4bbb8317-81d9-4e49-bd0b-32a4446ec505 could not be found. Aug 27 04:44:20.730668 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-cca78d9e-cf25-4e3c-aab4-1fd638554638 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Returning 404 to user: Instance 4bbb8317-81d9-4e49-bd0b-32a4446ec505 could not be found. {{(pid=108970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:44:20.731494 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-cca78d9e-cf25-4e3c-aab4-1fd638554638 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505" status: 404 len: 111 microversion: 2.1 time: 0.034253 Aug 27 04:44:20.732249 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 644/1292] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:44:20 2021] GET /compute/v2.1/servers/4bbb8317-81d9-4e49-bd0b-32a4446ec505 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:44:21.883447 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-2664df5e-ef63-446e-aefd-cfdc661370a8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:21.883948 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-2664df5e-ef63-446e-aefd-cfdc661370a8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:44:21.889998 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-2664df5e-ef63-446e-aefd-cfdc661370a8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:21.890442 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-2664df5e-ef63-446e-aefd-cfdc661370a8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:21.891204 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-2664df5e-ef63-446e-aefd-cfdc661370a8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:21.891629 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-2664df5e-ef63-446e-aefd-cfdc661370a8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:21.905167 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.wsgi [None req-2664df5e-ef63-446e-aefd-cfdc661370a8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] HTTP exception thrown: Instance b3173859-725e-4d66-80af-4223a6643935 could not be found. Aug 27 04:44:21.905764 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-2664df5e-ef63-446e-aefd-cfdc661370a8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Returning 404 to user: Instance b3173859-725e-4d66-80af-4223a6643935 could not be found. {{(pid=108971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:44:21.906568 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-2664df5e-ef63-446e-aefd-cfdc661370a8 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "DELETE /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 404 len: 111 microversion: 2.1 time: 0.027494 Aug 27 04:44:21.907112 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 649/1293] 10.222.0.53 () {58 vars in 1239 bytes} [Fri Aug 27 04:44:21 2021] DELETE /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:44:21.915400 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-1040a8e7-4f1e-463f-b9f6-20cd47c34c35 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:21.916040 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-1040a8e7-4f1e-463f-b9f6-20cd47c34c35 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] [instance: b3173859-725e-4d66-80af-4223a6643935] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:44:21.922054 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1040a8e7-4f1e-463f-b9f6-20cd47c34c35 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:21.922507 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1040a8e7-4f1e-463f-b9f6-20cd47c34c35 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:21.923309 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1040a8e7-4f1e-463f-b9f6-20cd47c34c35 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:21.923734 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1040a8e7-4f1e-463f-b9f6-20cd47c34c35 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:21.939087 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.wsgi [None req-1040a8e7-4f1e-463f-b9f6-20cd47c34c35 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] HTTP exception thrown: Instance b3173859-725e-4d66-80af-4223a6643935 could not be found. Aug 27 04:44:21.939676 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-1040a8e7-4f1e-463f-b9f6-20cd47c34c35 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] Returning 404 to user: Instance b3173859-725e-4d66-80af-4223a6643935 could not be found. {{(pid=108970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:44:21.941200 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-1040a8e7-4f1e-463f-b9f6-20cd47c34c35 tempest-AttachVolumeShelveTestJSON-463240310 tempest-AttachVolumeShelveTestJSON-463240310-project] 10.222.0.53 "GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935" status: 404 len: 111 microversion: 2.1 time: 0.029206 Aug 27 04:44:21.941200 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 645/1294] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:44:21 2021] GET /compute/v2.1/servers/b3173859-725e-4d66-80af-4223a6643935 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:44:27.438795 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-343e7d5c-87c2-4c62-ba74-73073593d372 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1587358633", "imageRef": "9356e2fa-e55b-41d9-9ca4-53393f2d79fd", "flavorRef": "452", "networks": [{"uuid": "dd42b135-3593-4e98-b507-9f2c85ac4990"}]}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:44:27.493272 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.network.neutron [None req-343e7d5c-87c2-4c62-ba74-73073593d372 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] validate_networks() for [('dd42b135-3593-4e98-b507-9f2c85ac4990', None, None, None, None, None)] {{(pid=108971) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 04:44:27.924417 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.virt.hardware [None req-343e7d5c-87c2-4c62-ba74-73073593d372 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Flavor limits 0:0:0 {{(pid=108971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:44:27.924829 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.virt.hardware [None req-343e7d5c-87c2-4c62-ba74-73073593d372 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Image limits 0:0:0 {{(pid=108971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:44:27.925301 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.virt.hardware [None req-343e7d5c-87c2-4c62-ba74-73073593d372 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Flavor pref 0:0:0 {{(pid=108971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:44:27.925701 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.virt.hardware [None req-343e7d5c-87c2-4c62-ba74-73073593d372 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Image pref 0:0:0 {{(pid=108971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:44:27.926105 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.virt.hardware [None req-343e7d5c-87c2-4c62-ba74-73073593d372 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:44:27.935558 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-343e7d5c-87c2-4c62-ba74-73073593d372 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:27.936029 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-343e7d5c-87c2-4c62-ba74-73073593d372 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:27.936847 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-343e7d5c-87c2-4c62-ba74-73073593d372 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:27.937336 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-343e7d5c-87c2-4c62-ba74-73073593d372 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:27.954041 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.quota [None req-343e7d5c-87c2-4c62-ba74-73073593d372 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Getting quotas for project b020e4046e594b05a242175f3df4dec0. Resources: {'ram', 'cores', 'instances'} {{(pid=108971) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:44:27.957944 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.quota [None req-343e7d5c-87c2-4c62-ba74-73073593d372 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Getting quotas for user 652113b414e74a148274e5658612a528 and project b020e4046e594b05a242175f3df4dec0. Resources: {'ram', 'cores', 'instances'} {{(pid=108971) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:44:27.969012 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-343e7d5c-87c2-4c62-ba74-73073593d372 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Going to run 1 instances... {{(pid=108971) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 04:44:27.971344 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-343e7d5c-87c2-4c62-ba74-73073593d372 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: d0f2a3fe-d7cd-448c-bb23-256ac860f4ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9356e2fa-e55b-41d9-9ca4-53393f2d79fd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 04:44:28.017429 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-343e7d5c-87c2-4c62-ba74-73073593d372 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.733414 Aug 27 04:44:28.018176 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 650/1295] 10.222.0.53 () {60 vars in 1147 bytes} [Fri Aug 27 04:44:27 2021] POST /compute/v2.1/servers => generated 380 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:44:28.028144 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-d3c6c789-0469-49a6-8bb1-ffbbc2f2877e tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:28.028889 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-d3c6c789-0469-49a6-8bb1-ffbbc2f2877e tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: d0f2a3fe-d7cd-448c-bb23-256ac860f4ca] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:44:28.086389 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-d3c6c789-0469-49a6-8bb1-ffbbc2f2877e tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:28.094294 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-d3c6c789-0469-49a6-8bb1-ffbbc2f2877e tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/d0f2a3fe-d7cd-448c-bb23-256ac860f4ca" status: 200 len: 1218 microversion: 2.1 time: 0.069921 Aug 27 04:44:28.095239 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 646/1296] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:44:28 2021] GET /compute/v2.1/servers/d0f2a3fe-d7cd-448c-bb23-256ac860f4ca => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:44:29.112469 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-4db699a0-4d60-4083-a8b6-f2bc99d202e5 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:29.113088 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-4db699a0-4d60-4083-a8b6-f2bc99d202e5 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: d0f2a3fe-d7cd-448c-bb23-256ac860f4ca] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:44:29.119419 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-4db699a0-4d60-4083-a8b6-f2bc99d202e5 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:29.119855 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-4db699a0-4d60-4083-a8b6-f2bc99d202e5 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:29.120651 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-4db699a0-4d60-4083-a8b6-f2bc99d202e5 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:29.121087 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-4db699a0-4d60-4083-a8b6-f2bc99d202e5 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:29.184418 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-4db699a0-4d60-4083-a8b6-f2bc99d202e5 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:29.191733 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-4db699a0-4d60-4083-a8b6-f2bc99d202e5 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/d0f2a3fe-d7cd-448c-bb23-256ac860f4ca" status: 200 len: 1222 microversion: 2.1 time: 0.083050 Aug 27 04:44:29.192395 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 651/1297] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:44:29 2021] GET /compute/v2.1/servers/d0f2a3fe-d7cd-448c-bb23-256ac860f4ca => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:44:30.209309 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-49c833e7-ef9b-4c9e-b6a9-247e4d56142d tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:30.209919 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-49c833e7-ef9b-4c9e-b6a9-247e4d56142d tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: d0f2a3fe-d7cd-448c-bb23-256ac860f4ca] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:44:30.216095 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-49c833e7-ef9b-4c9e-b6a9-247e4d56142d tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:30.216545 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-49c833e7-ef9b-4c9e-b6a9-247e4d56142d tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:30.217377 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-49c833e7-ef9b-4c9e-b6a9-247e4d56142d tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:30.217816 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-49c833e7-ef9b-4c9e-b6a9-247e4d56142d tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:30.278382 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-49c833e7-ef9b-4c9e-b6a9-247e4d56142d tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:30.286031 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-49c833e7-ef9b-4c9e-b6a9-247e4d56142d tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/d0f2a3fe-d7cd-448c-bb23-256ac860f4ca" status: 200 len: 1222 microversion: 2.1 time: 0.080858 Aug 27 04:44:30.286607 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 647/1298] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:44:30 2021] GET /compute/v2.1/servers/d0f2a3fe-d7cd-448c-bb23-256ac860f4ca => generated 1222 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:44:31.302366 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-4aa5c18b-1dd5-4f48-aa9e-95422c834bd4 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:31.303667 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-4aa5c18b-1dd5-4f48-aa9e-95422c834bd4 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: d0f2a3fe-d7cd-448c-bb23-256ac860f4ca] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:44:31.309668 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-4aa5c18b-1dd5-4f48-aa9e-95422c834bd4 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:31.310114 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-4aa5c18b-1dd5-4f48-aa9e-95422c834bd4 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:31.310894 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-4aa5c18b-1dd5-4f48-aa9e-95422c834bd4 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:31.311328 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-4aa5c18b-1dd5-4f48-aa9e-95422c834bd4 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:31.387127 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-4aa5c18b-1dd5-4f48-aa9e-95422c834bd4 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:31.394550 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-4aa5c18b-1dd5-4f48-aa9e-95422c834bd4 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/d0f2a3fe-d7cd-448c-bb23-256ac860f4ca" status: 200 len: 1222 microversion: 2.1 time: 0.095895 Aug 27 04:44:31.395109 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 652/1299] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:44:31 2021] GET /compute/v2.1/servers/d0f2a3fe-d7cd-448c-bb23-256ac860f4ca => generated 1222 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:44:32.410448 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-92f811cb-a7ca-4966-b4eb-d329d1ce325f tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:32.411068 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-92f811cb-a7ca-4966-b4eb-d329d1ce325f tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: d0f2a3fe-d7cd-448c-bb23-256ac860f4ca] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:44:32.417092 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-92f811cb-a7ca-4966-b4eb-d329d1ce325f tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:32.417545 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-92f811cb-a7ca-4966-b4eb-d329d1ce325f tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:32.418322 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-92f811cb-a7ca-4966-b4eb-d329d1ce325f tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:32.418757 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-92f811cb-a7ca-4966-b4eb-d329d1ce325f tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:32.492530 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-92f811cb-a7ca-4966-b4eb-d329d1ce325f tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:32.500322 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-92f811cb-a7ca-4966-b4eb-d329d1ce325f tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/d0f2a3fe-d7cd-448c-bb23-256ac860f4ca" status: 200 len: 1214 microversion: 2.1 time: 0.093459 Aug 27 04:44:32.501250 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 648/1300] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:44:32 2021] GET /compute/v2.1/servers/d0f2a3fe-d7cd-448c-bb23-256ac860f4ca => generated 1214 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:44:33.518292 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-728b5e5c-b7aa-4090-a868-69beee5dad04 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:33.519100 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-728b5e5c-b7aa-4090-a868-69beee5dad04 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: d0f2a3fe-d7cd-448c-bb23-256ac860f4ca] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:44:33.527290 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-728b5e5c-b7aa-4090-a868-69beee5dad04 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:33.527910 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-728b5e5c-b7aa-4090-a868-69beee5dad04 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:33.529072 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-728b5e5c-b7aa-4090-a868-69beee5dad04 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:33.529731 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-728b5e5c-b7aa-4090-a868-69beee5dad04 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:33.728371 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-728b5e5c-b7aa-4090-a868-69beee5dad04 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:33.736260 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-728b5e5c-b7aa-4090-a868-69beee5dad04 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/d0f2a3fe-d7cd-448c-bb23-256ac860f4ca" status: 200 len: 1318 microversion: 2.1 time: 0.221811 Aug 27 04:44:33.736833 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 653/1301] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:44:33 2021] GET /compute/v2.1/servers/d0f2a3fe-d7cd-448c-bb23-256ac860f4ca => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:44:34.480579 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [req-ed7613f3-59e8-4c17-af58-6f810be94bb4 req-372b0605-0a57-4051-9c9d-c826f120512e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0f2a3fe-d7cd-448c-bb23-256ac860f4ca", "tag": "44778afc-4a60-4718-8d59-c71e3bebde16"}]} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:44:34.483353 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:44:34.483353 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: warnings.warn(msg) Aug 27 04:44:34.494316 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-ed7613f3-59e8-4c17-af58-6f810be94bb4 req-372b0605-0a57-4051-9c9d-c826f120512e service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:34.495098 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-ed7613f3-59e8-4c17-af58-6f810be94bb4 req-372b0605-0a57-4051-9c9d-c826f120512e service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:34.518633 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.compute.server_external_events [req-ed7613f3-59e8-4c17-af58-6f810be94bb4 req-372b0605-0a57-4051-9c9d-c826f120512e service nova] Creating event network-changed:44778afc-4a60-4718-8d59-c71e3bebde16 for instance d0f2a3fe-d7cd-448c-bb23-256ac860f4ca on hv-cinder-80403 Aug 27 04:44:34.522392 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [req-ed7613f3-59e8-4c17-af58-6f810be94bb4 req-372b0605-0a57-4051-9c9d-c826f120512e service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046079 Aug 27 04:44:34.523035 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 649/1302] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:44:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:44:34.752702 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-4af63d30-bd41-40d2-b4c1-93860090eaca tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:34.753417 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-4af63d30-bd41-40d2-b4c1-93860090eaca tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: d0f2a3fe-d7cd-448c-bb23-256ac860f4ca] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:44:34.759298 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-4af63d30-bd41-40d2-b4c1-93860090eaca tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:34.759746 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-4af63d30-bd41-40d2-b4c1-93860090eaca tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:34.760564 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-4af63d30-bd41-40d2-b4c1-93860090eaca tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:34.761007 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-4af63d30-bd41-40d2-b4c1-93860090eaca tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:35.279793 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-4af63d30-bd41-40d2-b4c1-93860090eaca tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:35.292328 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-4af63d30-bd41-40d2-b4c1-93860090eaca tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/d0f2a3fe-d7cd-448c-bb23-256ac860f4ca" status: 200 len: 1318 microversion: 2.1 time: 0.543114 Aug 27 04:44:35.293538 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 654/1303] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:44:34 2021] GET /compute/v2.1/servers/d0f2a3fe-d7cd-448c-bb23-256ac860f4ca => generated 1318 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:44:36.310810 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-e56726e4-42f2-42ca-b8b4-2198fdceec6d tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:36.311541 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-e56726e4-42f2-42ca-b8b4-2198fdceec6d tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: d0f2a3fe-d7cd-448c-bb23-256ac860f4ca] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:44:36.317964 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e56726e4-42f2-42ca-b8b4-2198fdceec6d tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:36.319003 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e56726e4-42f2-42ca-b8b4-2198fdceec6d tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:36.319786 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e56726e4-42f2-42ca-b8b4-2198fdceec6d tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:36.320265 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e56726e4-42f2-42ca-b8b4-2198fdceec6d tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:36.466299 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-e56726e4-42f2-42ca-b8b4-2198fdceec6d tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:36.475290 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-e56726e4-42f2-42ca-b8b4-2198fdceec6d tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/d0f2a3fe-d7cd-448c-bb23-256ac860f4ca" status: 200 len: 1318 microversion: 2.1 time: 0.168288 Aug 27 04:44:36.475859 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 650/1304] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:44:36 2021] GET /compute/v2.1/servers/d0f2a3fe-d7cd-448c-bb23-256ac860f4ca => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:44:37.493026 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-a8b57d2f-540d-40f4-81ef-65a6ba649e7e tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:37.493672 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-a8b57d2f-540d-40f4-81ef-65a6ba649e7e tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: d0f2a3fe-d7cd-448c-bb23-256ac860f4ca] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:44:37.499802 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a8b57d2f-540d-40f4-81ef-65a6ba649e7e tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:37.500277 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a8b57d2f-540d-40f4-81ef-65a6ba649e7e tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:37.501057 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a8b57d2f-540d-40f4-81ef-65a6ba649e7e tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:37.501487 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a8b57d2f-540d-40f4-81ef-65a6ba649e7e tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:37.639244 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-a8b57d2f-540d-40f4-81ef-65a6ba649e7e tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:37.646727 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-a8b57d2f-540d-40f4-81ef-65a6ba649e7e tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/d0f2a3fe-d7cd-448c-bb23-256ac860f4ca" status: 200 len: 1318 microversion: 2.1 time: 0.157365 Aug 27 04:44:37.647310 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 655/1305] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:44:37 2021] GET /compute/v2.1/servers/d0f2a3fe-d7cd-448c-bb23-256ac860f4ca => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:44:38.664252 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-e661f314-8ebd-4ed7-a470-a85f4f96ea64 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:38.664799 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-e661f314-8ebd-4ed7-a470-a85f4f96ea64 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: d0f2a3fe-d7cd-448c-bb23-256ac860f4ca] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:44:38.670892 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e661f314-8ebd-4ed7-a470-a85f4f96ea64 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:38.671339 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e661f314-8ebd-4ed7-a470-a85f4f96ea64 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:38.672195 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e661f314-8ebd-4ed7-a470-a85f4f96ea64 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:38.672635 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e661f314-8ebd-4ed7-a470-a85f4f96ea64 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:38.800157 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-e661f314-8ebd-4ed7-a470-a85f4f96ea64 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:38.808114 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-e661f314-8ebd-4ed7-a470-a85f4f96ea64 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/d0f2a3fe-d7cd-448c-bb23-256ac860f4ca" status: 200 len: 1318 microversion: 2.1 time: 0.148183 Aug 27 04:44:38.808703 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 651/1306] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:44:38 2021] GET /compute/v2.1/servers/d0f2a3fe-d7cd-448c-bb23-256ac860f4ca => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:44:39.824673 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-d9c20269-0870-4e4c-b07f-1c9ab2bdea08 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:39.825299 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-d9c20269-0870-4e4c-b07f-1c9ab2bdea08 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: d0f2a3fe-d7cd-448c-bb23-256ac860f4ca] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:44:39.831280 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d9c20269-0870-4e4c-b07f-1c9ab2bdea08 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:39.831722 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d9c20269-0870-4e4c-b07f-1c9ab2bdea08 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:39.832525 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d9c20269-0870-4e4c-b07f-1c9ab2bdea08 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:39.832959 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d9c20269-0870-4e4c-b07f-1c9ab2bdea08 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:39.970373 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-d9c20269-0870-4e4c-b07f-1c9ab2bdea08 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:39.978454 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-d9c20269-0870-4e4c-b07f-1c9ab2bdea08 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/d0f2a3fe-d7cd-448c-bb23-256ac860f4ca" status: 200 len: 1318 microversion: 2.1 time: 0.157479 Aug 27 04:44:39.979026 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 656/1307] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:44:39 2021] GET /compute/v2.1/servers/d0f2a3fe-d7cd-448c-bb23-256ac860f4ca => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:44:40.995211 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-6b11490c-549c-484c-8cac-7407c21cb175 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:40.995753 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-6b11490c-549c-484c-8cac-7407c21cb175 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: d0f2a3fe-d7cd-448c-bb23-256ac860f4ca] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:44:41.001833 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6b11490c-549c-484c-8cac-7407c21cb175 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:41.002269 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6b11490c-549c-484c-8cac-7407c21cb175 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:41.003034 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6b11490c-549c-484c-8cac-7407c21cb175 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:41.003464 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6b11490c-549c-484c-8cac-7407c21cb175 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:41.128591 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-6b11490c-549c-484c-8cac-7407c21cb175 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:41.136357 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-6b11490c-549c-484c-8cac-7407c21cb175 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/d0f2a3fe-d7cd-448c-bb23-256ac860f4ca" status: 200 len: 1318 microversion: 2.1 time: 0.144830 Aug 27 04:44:41.136953 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 652/1308] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:44:40 2021] GET /compute/v2.1/servers/d0f2a3fe-d7cd-448c-bb23-256ac860f4ca => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:44:42.152591 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-e455dd19-52e5-4e2c-a730-5c06c1995ae1 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:42.153193 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-e455dd19-52e5-4e2c-a730-5c06c1995ae1 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: d0f2a3fe-d7cd-448c-bb23-256ac860f4ca] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:44:42.159585 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e455dd19-52e5-4e2c-a730-5c06c1995ae1 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:42.160098 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e455dd19-52e5-4e2c-a730-5c06c1995ae1 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:42.160904 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e455dd19-52e5-4e2c-a730-5c06c1995ae1 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:42.161333 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e455dd19-52e5-4e2c-a730-5c06c1995ae1 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:42.289922 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-e455dd19-52e5-4e2c-a730-5c06c1995ae1 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:42.298696 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-e455dd19-52e5-4e2c-a730-5c06c1995ae1 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/d0f2a3fe-d7cd-448c-bb23-256ac860f4ca" status: 200 len: 1318 microversion: 2.1 time: 0.149778 Aug 27 04:44:42.299260 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 657/1309] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:44:42 2021] GET /compute/v2.1/servers/d0f2a3fe-d7cd-448c-bb23-256ac860f4ca => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:44:43.316092 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-5484836e-092b-4e4a-bd70-9fa9a3176832 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:43.316661 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-5484836e-092b-4e4a-bd70-9fa9a3176832 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: d0f2a3fe-d7cd-448c-bb23-256ac860f4ca] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:44:43.323266 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5484836e-092b-4e4a-bd70-9fa9a3176832 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:43.323720 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5484836e-092b-4e4a-bd70-9fa9a3176832 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:43.324539 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5484836e-092b-4e4a-bd70-9fa9a3176832 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:43.324985 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5484836e-092b-4e4a-bd70-9fa9a3176832 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:43.447160 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-5484836e-092b-4e4a-bd70-9fa9a3176832 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:43.454599 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-5484836e-092b-4e4a-bd70-9fa9a3176832 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/d0f2a3fe-d7cd-448c-bb23-256ac860f4ca" status: 200 len: 1318 microversion: 2.1 time: 0.142438 Aug 27 04:44:43.455175 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 653/1310] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:44:43 2021] GET /compute/v2.1/servers/d0f2a3fe-d7cd-448c-bb23-256ac860f4ca => generated 1318 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:44:44.473517 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-cb8a4165-6e5e-4135-b43e-6f263c2230f3 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:44.474366 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-cb8a4165-6e5e-4135-b43e-6f263c2230f3 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: d0f2a3fe-d7cd-448c-bb23-256ac860f4ca] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:44:44.481598 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cb8a4165-6e5e-4135-b43e-6f263c2230f3 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:44.482115 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cb8a4165-6e5e-4135-b43e-6f263c2230f3 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:44.482963 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cb8a4165-6e5e-4135-b43e-6f263c2230f3 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:44.483501 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cb8a4165-6e5e-4135-b43e-6f263c2230f3 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:44.618891 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-cb8a4165-6e5e-4135-b43e-6f263c2230f3 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:44.626187 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-cb8a4165-6e5e-4135-b43e-6f263c2230f3 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/d0f2a3fe-d7cd-448c-bb23-256ac860f4ca" status: 200 len: 1318 microversion: 2.1 time: 0.156433 Aug 27 04:44:44.626759 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 658/1311] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:44:44 2021] GET /compute/v2.1/servers/d0f2a3fe-d7cd-448c-bb23-256ac860f4ca => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:44:45.642434 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-d40bfb83-c12b-404c-9865-e105d156f02b tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:45.643277 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-d40bfb83-c12b-404c-9865-e105d156f02b tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: d0f2a3fe-d7cd-448c-bb23-256ac860f4ca] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:44:45.650105 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d40bfb83-c12b-404c-9865-e105d156f02b tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:45.650559 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d40bfb83-c12b-404c-9865-e105d156f02b tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:45.651343 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d40bfb83-c12b-404c-9865-e105d156f02b tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:45.651781 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d40bfb83-c12b-404c-9865-e105d156f02b tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:45.795535 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-d40bfb83-c12b-404c-9865-e105d156f02b tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:45.806898 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-d40bfb83-c12b-404c-9865-e105d156f02b tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/d0f2a3fe-d7cd-448c-bb23-256ac860f4ca" status: 200 len: 1318 microversion: 2.1 time: 0.168074 Aug 27 04:44:45.807660 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 654/1312] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:44:45 2021] GET /compute/v2.1/servers/d0f2a3fe-d7cd-448c-bb23-256ac860f4ca => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:44:46.829673 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-13a6e32e-5992-41b9-b015-6e0e6775a152 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:46.831017 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-13a6e32e-5992-41b9-b015-6e0e6775a152 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: d0f2a3fe-d7cd-448c-bb23-256ac860f4ca] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:44:46.838227 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-13a6e32e-5992-41b9-b015-6e0e6775a152 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:46.838953 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-13a6e32e-5992-41b9-b015-6e0e6775a152 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:46.839855 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-13a6e32e-5992-41b9-b015-6e0e6775a152 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:46.840424 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-13a6e32e-5992-41b9-b015-6e0e6775a152 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:46.982583 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-13a6e32e-5992-41b9-b015-6e0e6775a152 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:46.992730 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-13a6e32e-5992-41b9-b015-6e0e6775a152 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/d0f2a3fe-d7cd-448c-bb23-256ac860f4ca" status: 200 len: 1318 microversion: 2.1 time: 0.169804 Aug 27 04:44:46.993936 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 659/1313] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:44:46 2021] GET /compute/v2.1/servers/d0f2a3fe-d7cd-448c-bb23-256ac860f4ca => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:44:47.023743 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [req-19254db5-a112-4fd3-97ed-74e1685fc374 req-ca60c1de-a02b-402d-9964-1176047157ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0f2a3fe-d7cd-448c-bb23-256ac860f4ca", "name": "network-vif-plugged", "status": "completed", "tag": "44778afc-4a60-4718-8d59-c71e3bebde16"}]} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:44:47.025483 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:44:47.025483 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: warnings.warn(msg) Aug 27 04:44:47.044228 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-19254db5-a112-4fd3-97ed-74e1685fc374 req-ca60c1de-a02b-402d-9964-1176047157ca service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:47.044821 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-19254db5-a112-4fd3-97ed-74e1685fc374 req-ca60c1de-a02b-402d-9964-1176047157ca service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:47.057559 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.compute.server_external_events [req-19254db5-a112-4fd3-97ed-74e1685fc374 req-ca60c1de-a02b-402d-9964-1176047157ca service nova] Creating event network-vif-plugged:44778afc-4a60-4718-8d59-c71e3bebde16 for instance d0f2a3fe-d7cd-448c-bb23-256ac860f4ca on hv-cinder-80403 Aug 27 04:44:47.063117 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [req-19254db5-a112-4fd3-97ed-74e1685fc374 req-ca60c1de-a02b-402d-9964-1176047157ca service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043305 Aug 27 04:44:47.063843 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 655/1314] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:44:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:44:48.010027 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-5d7d4f54-ee37-4f2e-a409-df8b42d2e367 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:48.010663 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-5d7d4f54-ee37-4f2e-a409-df8b42d2e367 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: d0f2a3fe-d7cd-448c-bb23-256ac860f4ca] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:44:48.017589 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5d7d4f54-ee37-4f2e-a409-df8b42d2e367 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:48.018046 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5d7d4f54-ee37-4f2e-a409-df8b42d2e367 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:48.018867 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5d7d4f54-ee37-4f2e-a409-df8b42d2e367 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:48.019306 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5d7d4f54-ee37-4f2e-a409-df8b42d2e367 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:48.158520 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-5d7d4f54-ee37-4f2e-a409-df8b42d2e367 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:48.166487 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-5d7d4f54-ee37-4f2e-a409-df8b42d2e367 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/d0f2a3fe-d7cd-448c-bb23-256ac860f4ca" status: 200 len: 1318 microversion: 2.1 time: 0.161183 Aug 27 04:44:48.167063 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 660/1315] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:44:48 2021] GET /compute/v2.1/servers/d0f2a3fe-d7cd-448c-bb23-256ac860f4ca => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:44:49.184716 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-3ee7ff51-f2ea-4e35-a380-c8d236cccd0c tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:44:49.185862 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-3ee7ff51-f2ea-4e35-a380-c8d236cccd0c tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: d0f2a3fe-d7cd-448c-bb23-256ac860f4ca] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:44:49.193025 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3ee7ff51-f2ea-4e35-a380-c8d236cccd0c tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:49.193479 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3ee7ff51-f2ea-4e35-a380-c8d236cccd0c tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:49.194309 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3ee7ff51-f2ea-4e35-a380-c8d236cccd0c tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:49.194733 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3ee7ff51-f2ea-4e35-a380-c8d236cccd0c tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:49.338913 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-3ee7ff51-f2ea-4e35-a380-c8d236cccd0c tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:44:49.346889 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-3ee7ff51-f2ea-4e35-a380-c8d236cccd0c tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/d0f2a3fe-d7cd-448c-bb23-256ac860f4ca" status: 200 len: 1509 microversion: 2.1 time: 0.166408 Aug 27 04:44:49.347478 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 656/1316] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:44:49 2021] GET /compute/v2.1/servers/d0f2a3fe-d7cd-448c-bb23-256ac860f4ca => generated 1509 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:44:50.760297 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-700783dd-4602-428b-83b0-ecedef026645 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9aae2dee-5bd3-4761-aefd-7452af1b8141"}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:44:50.761405 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-700783dd-4602-428b-83b0-ecedef026645 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: d0f2a3fe-d7cd-448c-bb23-256ac860f4ca] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:44:50.772468 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-700783dd-4602-428b-83b0-ecedef026645 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:50.772915 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-700783dd-4602-428b-83b0-ecedef026645 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:50.773716 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-700783dd-4602-428b-83b0-ecedef026645 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:50.774152 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-700783dd-4602-428b-83b0-ecedef026645 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:51.056780 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-700783dd-4602-428b-83b0-ecedef026645 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "POST /compute/v2.1/servers/d0f2a3fe-d7cd-448c-bb23-256ac860f4ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.300000 Aug 27 04:44:51.057399 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 661/1317] 10.222.0.53 () {60 vars in 1323 bytes} [Fri Aug 27 04:44:50 2021] POST /compute/v2.1/servers/d0f2a3fe-d7cd-448c-bb23-256ac860f4ca/os-volume_attachments => generated 194 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:44:58.743356 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-d7fb6acd-1d97-4a5d-9012-5525b48005a4 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-56022741", "imageRef": "9356e2fa-e55b-41d9-9ca4-53393f2d79fd", "flavorRef": "452", "networks": [{"uuid": "dd42b135-3593-4e98-b507-9f2c85ac4990"}]}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:44:58.817954 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.network.neutron [None req-d7fb6acd-1d97-4a5d-9012-5525b48005a4 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] validate_networks() for [('dd42b135-3593-4e98-b507-9f2c85ac4990', None, None, None, None, None)] {{(pid=108970) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 04:44:59.289728 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.virt.hardware [None req-d7fb6acd-1d97-4a5d-9012-5525b48005a4 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Flavor limits 0:0:0 {{(pid=108970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:44:59.290197 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.virt.hardware [None req-d7fb6acd-1d97-4a5d-9012-5525b48005a4 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Image limits 0:0:0 {{(pid=108970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:44:59.290676 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.virt.hardware [None req-d7fb6acd-1d97-4a5d-9012-5525b48005a4 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Flavor pref 0:0:0 {{(pid=108970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:44:59.291077 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.virt.hardware [None req-d7fb6acd-1d97-4a5d-9012-5525b48005a4 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Image pref 0:0:0 {{(pid=108970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:44:59.291483 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.virt.hardware [None req-d7fb6acd-1d97-4a5d-9012-5525b48005a4 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:44:59.300029 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d7fb6acd-1d97-4a5d-9012-5525b48005a4 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:59.300472 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d7fb6acd-1d97-4a5d-9012-5525b48005a4 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:59.301272 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d7fb6acd-1d97-4a5d-9012-5525b48005a4 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:44:59.301704 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d7fb6acd-1d97-4a5d-9012-5525b48005a4 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:44:59.304606 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:44:59.305131 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: Fri Aug 27 04:44:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:44:59.320875 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.quota [None req-d7fb6acd-1d97-4a5d-9012-5525b48005a4 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Getting quotas for project b020e4046e594b05a242175f3df4dec0. Resources: {'ram', 'cores', 'instances'} {{(pid=108970) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:44:59.325508 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.quota [None req-d7fb6acd-1d97-4a5d-9012-5525b48005a4 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Getting quotas for user 652113b414e74a148274e5658612a528 and project b020e4046e594b05a242175f3df4dec0. Resources: {'ram', 'cores', 'instances'} {{(pid=108970) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:44:59.336186 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-d7fb6acd-1d97-4a5d-9012-5525b48005a4 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Going to run 1 instances... {{(pid=108970) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 04:44:59.338511 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-d7fb6acd-1d97-4a5d-9012-5525b48005a4 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: b9e15d7c-e87e-45b6-a76b-9562f31480ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9356e2fa-e55b-41d9-9ca4-53393f2d79fd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 04:44:59.388508 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d7fb6acd-1d97-4a5d-9012-5525b48005a4 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [d0a0261a-1605-4109-9041-8fa7995fac09] AMQP server on 10.222.0.53:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 04:45:00.405535 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO oslo.messaging._drivers.impl_rabbit [None req-d7fb6acd-1d97-4a5d-9012-5525b48005a4 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [d0a0261a-1605-4109-9041-8fa7995fac09] Reconnected to AMQP server on 10.222.0.53:5672 via [amqp] client with port 46202. Aug 27 04:45:00.409290 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-d7fb6acd-1d97-4a5d-9012-5525b48005a4 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.672978 Aug 27 04:45:00.410116 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 657/1318] 10.222.0.53 () {60 vars in 1147 bytes} [Fri Aug 27 04:44:58 2021] POST /compute/v2.1/servers => generated 380 bytes in 1674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:45:00.420582 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-8b399efd-e7c4-4b9b-ac8f-83fe6e79255b tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:00.421279 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-8b399efd-e7c4-4b9b-ac8f-83fe6e79255b tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: b9e15d7c-e87e-45b6-a76b-9562f31480ec] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:45:00.478844 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-8b399efd-e7c4-4b9b-ac8f-83fe6e79255b tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:00.485888 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-8b399efd-e7c4-4b9b-ac8f-83fe6e79255b tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/b9e15d7c-e87e-45b6-a76b-9562f31480ec" status: 200 len: 1216 microversion: 2.1 time: 0.069820 Aug 27 04:45:00.486451 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 662/1319] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:45:00 2021] GET /compute/v2.1/servers/b9e15d7c-e87e-45b6-a76b-9562f31480ec => generated 1216 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:01.503016 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-399a8372-8138-4aca-97d1-22fb619aaa51 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:01.503630 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-399a8372-8138-4aca-97d1-22fb619aaa51 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: b9e15d7c-e87e-45b6-a76b-9562f31480ec] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:45:01.510246 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-399a8372-8138-4aca-97d1-22fb619aaa51 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:01.510689 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-399a8372-8138-4aca-97d1-22fb619aaa51 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:01.511450 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-399a8372-8138-4aca-97d1-22fb619aaa51 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:01.511888 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-399a8372-8138-4aca-97d1-22fb619aaa51 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:01.571066 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-399a8372-8138-4aca-97d1-22fb619aaa51 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:01.578264 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-399a8372-8138-4aca-97d1-22fb619aaa51 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/b9e15d7c-e87e-45b6-a76b-9562f31480ec" status: 200 len: 1220 microversion: 2.1 time: 0.078974 Aug 27 04:45:01.578827 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 658/1320] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:45:01 2021] GET /compute/v2.1/servers/b9e15d7c-e87e-45b6-a76b-9562f31480ec => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:02.595432 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-540af7f7-ca93-46ae-b776-f9ca071e453a tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:02.596068 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-540af7f7-ca93-46ae-b776-f9ca071e453a tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: b9e15d7c-e87e-45b6-a76b-9562f31480ec] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:45:02.603455 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-540af7f7-ca93-46ae-b776-f9ca071e453a tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:02.603900 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-540af7f7-ca93-46ae-b776-f9ca071e453a tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:02.604951 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-540af7f7-ca93-46ae-b776-f9ca071e453a tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:02.605387 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-540af7f7-ca93-46ae-b776-f9ca071e453a tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:02.665562 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-540af7f7-ca93-46ae-b776-f9ca071e453a tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:02.672932 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-540af7f7-ca93-46ae-b776-f9ca071e453a tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/b9e15d7c-e87e-45b6-a76b-9562f31480ec" status: 200 len: 1220 microversion: 2.1 time: 0.081294 Aug 27 04:45:02.673501 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 663/1321] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:45:02 2021] GET /compute/v2.1/servers/b9e15d7c-e87e-45b6-a76b-9562f31480ec => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:03.690237 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-b3bc3bf8-5183-40f6-afd9-d04ccd21f2fa tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:03.690769 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-b3bc3bf8-5183-40f6-afd9-d04ccd21f2fa tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: b9e15d7c-e87e-45b6-a76b-9562f31480ec] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:45:03.697404 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b3bc3bf8-5183-40f6-afd9-d04ccd21f2fa tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:03.697853 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b3bc3bf8-5183-40f6-afd9-d04ccd21f2fa tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:03.698620 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b3bc3bf8-5183-40f6-afd9-d04ccd21f2fa tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:03.699061 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b3bc3bf8-5183-40f6-afd9-d04ccd21f2fa tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:03.757352 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-b3bc3bf8-5183-40f6-afd9-d04ccd21f2fa tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:03.764687 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-b3bc3bf8-5183-40f6-afd9-d04ccd21f2fa tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/b9e15d7c-e87e-45b6-a76b-9562f31480ec" status: 200 len: 1268 microversion: 2.1 time: 0.078211 Aug 27 04:45:03.765249 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 659/1322] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:45:03 2021] GET /compute/v2.1/servers/b9e15d7c-e87e-45b6-a76b-9562f31480ec => generated 1268 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:04.782318 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-430ae881-4422-49a0-a5da-0d1a56e73d40 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:04.783036 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-430ae881-4422-49a0-a5da-0d1a56e73d40 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: b9e15d7c-e87e-45b6-a76b-9562f31480ec] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:45:04.789961 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-430ae881-4422-49a0-a5da-0d1a56e73d40 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:04.790417 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-430ae881-4422-49a0-a5da-0d1a56e73d40 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:04.791203 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-430ae881-4422-49a0-a5da-0d1a56e73d40 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:04.791643 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-430ae881-4422-49a0-a5da-0d1a56e73d40 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:05.006983 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-430ae881-4422-49a0-a5da-0d1a56e73d40 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:05.014106 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-430ae881-4422-49a0-a5da-0d1a56e73d40 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/b9e15d7c-e87e-45b6-a76b-9562f31480ec" status: 200 len: 1316 microversion: 2.1 time: 0.235597 Aug 27 04:45:05.014664 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 664/1323] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:45:04 2021] GET /compute/v2.1/servers/b9e15d7c-e87e-45b6-a76b-9562f31480ec => generated 1316 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:05.291425 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [req-6f495f73-b560-432c-9775-e06bfc031726 req-80f4dacd-d7ba-46aa-82e8-3755f04122f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9e15d7c-e87e-45b6-a76b-9562f31480ec", "tag": "92cbb9c8-5d2b-40f8-bba4-0e8c580aab29"}]} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:45:05.293134 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:45:05.293134 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: warnings.warn(msg) Aug 27 04:45:05.299792 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-6f495f73-b560-432c-9775-e06bfc031726 req-80f4dacd-d7ba-46aa-82e8-3755f04122f4 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:05.300246 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-6f495f73-b560-432c-9775-e06bfc031726 req-80f4dacd-d7ba-46aa-82e8-3755f04122f4 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:05.311903 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.compute.server_external_events [req-6f495f73-b560-432c-9775-e06bfc031726 req-80f4dacd-d7ba-46aa-82e8-3755f04122f4 service nova] Creating event network-changed:92cbb9c8-5d2b-40f8-bba4-0e8c580aab29 for instance b9e15d7c-e87e-45b6-a76b-9562f31480ec on hv-cinder-80403 Aug 27 04:45:05.316700 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [req-6f495f73-b560-432c-9775-e06bfc031726 req-80f4dacd-d7ba-46aa-82e8-3755f04122f4 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029359 Aug 27 04:45:05.317293 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 660/1324] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:45:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:45:06.036148 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-3835c212-cddd-488f-920f-5b73d2bf223b tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:06.036758 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-3835c212-cddd-488f-920f-5b73d2bf223b tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: b9e15d7c-e87e-45b6-a76b-9562f31480ec] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:45:06.043018 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3835c212-cddd-488f-920f-5b73d2bf223b tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:06.043463 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3835c212-cddd-488f-920f-5b73d2bf223b tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:06.044267 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3835c212-cddd-488f-920f-5b73d2bf223b tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:06.044698 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3835c212-cddd-488f-920f-5b73d2bf223b tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:06.169595 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-3835c212-cddd-488f-920f-5b73d2bf223b tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:06.176848 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-3835c212-cddd-488f-920f-5b73d2bf223b tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/b9e15d7c-e87e-45b6-a76b-9562f31480ec" status: 200 len: 1316 microversion: 2.1 time: 0.144513 Aug 27 04:45:06.177408 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 665/1325] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:45:06 2021] GET /compute/v2.1/servers/b9e15d7c-e87e-45b6-a76b-9562f31480ec => generated 1316 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:07.194574 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-5e9946f5-12b9-48e2-999f-ec01dd66a177 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:07.195300 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-5e9946f5-12b9-48e2-999f-ec01dd66a177 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: b9e15d7c-e87e-45b6-a76b-9562f31480ec] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:45:07.201643 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5e9946f5-12b9-48e2-999f-ec01dd66a177 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:07.202094 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5e9946f5-12b9-48e2-999f-ec01dd66a177 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:07.202874 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5e9946f5-12b9-48e2-999f-ec01dd66a177 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:07.203316 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5e9946f5-12b9-48e2-999f-ec01dd66a177 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:07.329552 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-5e9946f5-12b9-48e2-999f-ec01dd66a177 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:07.337614 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-5e9946f5-12b9-48e2-999f-ec01dd66a177 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/b9e15d7c-e87e-45b6-a76b-9562f31480ec" status: 200 len: 1316 microversion: 2.1 time: 0.147084 Aug 27 04:45:07.338189 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 661/1326] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:45:07 2021] GET /compute/v2.1/servers/b9e15d7c-e87e-45b6-a76b-9562f31480ec => generated 1316 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:08.354957 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-cc3e8939-1aa2-4700-9f3a-4c675dbede26 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:08.355553 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-cc3e8939-1aa2-4700-9f3a-4c675dbede26 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: b9e15d7c-e87e-45b6-a76b-9562f31480ec] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:45:08.362087 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cc3e8939-1aa2-4700-9f3a-4c675dbede26 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:08.362471 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cc3e8939-1aa2-4700-9f3a-4c675dbede26 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:08.363249 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cc3e8939-1aa2-4700-9f3a-4c675dbede26 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:08.363683 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cc3e8939-1aa2-4700-9f3a-4c675dbede26 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:08.488948 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-cc3e8939-1aa2-4700-9f3a-4c675dbede26 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:08.496249 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-cc3e8939-1aa2-4700-9f3a-4c675dbede26 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/b9e15d7c-e87e-45b6-a76b-9562f31480ec" status: 200 len: 1316 microversion: 2.1 time: 0.145202 Aug 27 04:45:08.496806 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 666/1327] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:45:08 2021] GET /compute/v2.1/servers/b9e15d7c-e87e-45b6-a76b-9562f31480ec => generated 1316 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:09.512901 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-17b5e877-fa32-4d24-bc61-f2afe7eeb638 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:09.513517 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-17b5e877-fa32-4d24-bc61-f2afe7eeb638 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: b9e15d7c-e87e-45b6-a76b-9562f31480ec] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:45:09.519811 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-17b5e877-fa32-4d24-bc61-f2afe7eeb638 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:09.520303 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-17b5e877-fa32-4d24-bc61-f2afe7eeb638 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:09.521082 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-17b5e877-fa32-4d24-bc61-f2afe7eeb638 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:09.521520 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-17b5e877-fa32-4d24-bc61-f2afe7eeb638 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:09.644963 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-17b5e877-fa32-4d24-bc61-f2afe7eeb638 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:09.652831 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-17b5e877-fa32-4d24-bc61-f2afe7eeb638 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/b9e15d7c-e87e-45b6-a76b-9562f31480ec" status: 200 len: 1316 microversion: 2.1 time: 0.143946 Aug 27 04:45:09.653425 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 662/1328] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:45:09 2021] GET /compute/v2.1/servers/b9e15d7c-e87e-45b6-a76b-9562f31480ec => generated 1316 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:10.670677 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-cb9a3257-08e3-479c-8628-f2905627d1fd tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:10.671220 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-cb9a3257-08e3-479c-8628-f2905627d1fd tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: b9e15d7c-e87e-45b6-a76b-9562f31480ec] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:45:10.677028 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cb9a3257-08e3-479c-8628-f2905627d1fd tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:10.677468 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cb9a3257-08e3-479c-8628-f2905627d1fd tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:10.678721 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cb9a3257-08e3-479c-8628-f2905627d1fd tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:10.679146 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cb9a3257-08e3-479c-8628-f2905627d1fd tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:10.798977 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-cb9a3257-08e3-479c-8628-f2905627d1fd tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:10.806734 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-cb9a3257-08e3-479c-8628-f2905627d1fd tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/b9e15d7c-e87e-45b6-a76b-9562f31480ec" status: 200 len: 1316 microversion: 2.1 time: 0.140321 Aug 27 04:45:10.807288 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 667/1329] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:45:10 2021] GET /compute/v2.1/servers/b9e15d7c-e87e-45b6-a76b-9562f31480ec => generated 1316 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:11.824231 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-1a2fda17-e29c-4ddd-b4a0-927a84543808 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:11.824849 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-1a2fda17-e29c-4ddd-b4a0-927a84543808 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: b9e15d7c-e87e-45b6-a76b-9562f31480ec] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:45:11.830970 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1a2fda17-e29c-4ddd-b4a0-927a84543808 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:11.831409 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1a2fda17-e29c-4ddd-b4a0-927a84543808 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:11.832207 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1a2fda17-e29c-4ddd-b4a0-927a84543808 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:11.832647 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1a2fda17-e29c-4ddd-b4a0-927a84543808 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:11.962349 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-1a2fda17-e29c-4ddd-b4a0-927a84543808 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:11.969694 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-1a2fda17-e29c-4ddd-b4a0-927a84543808 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/b9e15d7c-e87e-45b6-a76b-9562f31480ec" status: 200 len: 1316 microversion: 2.1 time: 0.149286 Aug 27 04:45:11.970261 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 663/1330] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:45:11 2021] GET /compute/v2.1/servers/b9e15d7c-e87e-45b6-a76b-9562f31480ec => generated 1316 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:45:12.986030 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-bd4560db-fcc5-4332-bbfe-31c568fe6fd9 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:12.986637 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-bd4560db-fcc5-4332-bbfe-31c568fe6fd9 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: b9e15d7c-e87e-45b6-a76b-9562f31480ec] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:45:12.993092 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-bd4560db-fcc5-4332-bbfe-31c568fe6fd9 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:12.993540 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-bd4560db-fcc5-4332-bbfe-31c568fe6fd9 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:12.994294 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-bd4560db-fcc5-4332-bbfe-31c568fe6fd9 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:12.994724 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-bd4560db-fcc5-4332-bbfe-31c568fe6fd9 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:13.114863 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-bd4560db-fcc5-4332-bbfe-31c568fe6fd9 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:13.122620 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-bd4560db-fcc5-4332-bbfe-31c568fe6fd9 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/b9e15d7c-e87e-45b6-a76b-9562f31480ec" status: 200 len: 1316 microversion: 2.1 time: 0.140289 Aug 27 04:45:13.123176 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 668/1331] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:45:12 2021] GET /compute/v2.1/servers/b9e15d7c-e87e-45b6-a76b-9562f31480ec => generated 1316 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:14.138471 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-9283991a-5d11-495d-9264-b3ad1f8fee39 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:14.139114 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-9283991a-5d11-495d-9264-b3ad1f8fee39 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: b9e15d7c-e87e-45b6-a76b-9562f31480ec] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:45:14.145074 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9283991a-5d11-495d-9264-b3ad1f8fee39 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:14.145526 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9283991a-5d11-495d-9264-b3ad1f8fee39 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:14.146295 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9283991a-5d11-495d-9264-b3ad1f8fee39 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:14.147386 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9283991a-5d11-495d-9264-b3ad1f8fee39 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:14.272946 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-9283991a-5d11-495d-9264-b3ad1f8fee39 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:14.280266 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-9283991a-5d11-495d-9264-b3ad1f8fee39 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/b9e15d7c-e87e-45b6-a76b-9562f31480ec" status: 200 len: 1316 microversion: 2.1 time: 0.145446 Aug 27 04:45:14.280837 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 664/1332] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:45:14 2021] GET /compute/v2.1/servers/b9e15d7c-e87e-45b6-a76b-9562f31480ec => generated 1316 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:15.296702 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-8866a205-4e9f-432f-a124-cfd272898ba0 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:15.297437 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-8866a205-4e9f-432f-a124-cfd272898ba0 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: b9e15d7c-e87e-45b6-a76b-9562f31480ec] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:45:15.303528 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8866a205-4e9f-432f-a124-cfd272898ba0 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:15.303980 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8866a205-4e9f-432f-a124-cfd272898ba0 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:15.305002 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8866a205-4e9f-432f-a124-cfd272898ba0 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:15.305536 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8866a205-4e9f-432f-a124-cfd272898ba0 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:15.425482 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-8866a205-4e9f-432f-a124-cfd272898ba0 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:15.432773 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-8866a205-4e9f-432f-a124-cfd272898ba0 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/b9e15d7c-e87e-45b6-a76b-9562f31480ec" status: 200 len: 1316 microversion: 2.1 time: 0.139849 Aug 27 04:45:15.433330 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 669/1333] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:45:15 2021] GET /compute/v2.1/servers/b9e15d7c-e87e-45b6-a76b-9562f31480ec => generated 1316 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:16.448696 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-a147c8a9-cc7f-44cb-bf7a-4b98fcb277d7 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:16.449308 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-a147c8a9-cc7f-44cb-bf7a-4b98fcb277d7 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: b9e15d7c-e87e-45b6-a76b-9562f31480ec] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:45:16.455545 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a147c8a9-cc7f-44cb-bf7a-4b98fcb277d7 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:16.456023 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a147c8a9-cc7f-44cb-bf7a-4b98fcb277d7 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:16.456825 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a147c8a9-cc7f-44cb-bf7a-4b98fcb277d7 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:16.457265 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a147c8a9-cc7f-44cb-bf7a-4b98fcb277d7 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:16.581133 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-a147c8a9-cc7f-44cb-bf7a-4b98fcb277d7 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:16.589398 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-a147c8a9-cc7f-44cb-bf7a-4b98fcb277d7 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/b9e15d7c-e87e-45b6-a76b-9562f31480ec" status: 200 len: 1316 microversion: 2.1 time: 0.144406 Aug 27 04:45:16.589985 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 665/1334] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:45:16 2021] GET /compute/v2.1/servers/b9e15d7c-e87e-45b6-a76b-9562f31480ec => generated 1316 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:17.606638 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-e0637b30-4ebc-41e8-b81d-30518393fed9 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:17.607376 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-e0637b30-4ebc-41e8-b81d-30518393fed9 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: b9e15d7c-e87e-45b6-a76b-9562f31480ec] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:45:17.613838 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e0637b30-4ebc-41e8-b81d-30518393fed9 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:17.614281 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e0637b30-4ebc-41e8-b81d-30518393fed9 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:17.615061 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e0637b30-4ebc-41e8-b81d-30518393fed9 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:17.616114 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e0637b30-4ebc-41e8-b81d-30518393fed9 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:17.839765 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-e0637b30-4ebc-41e8-b81d-30518393fed9 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:17.847194 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-e0637b30-4ebc-41e8-b81d-30518393fed9 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/b9e15d7c-e87e-45b6-a76b-9562f31480ec" status: 200 len: 1316 microversion: 2.1 time: 0.244433 Aug 27 04:45:17.847772 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 670/1335] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:45:17 2021] GET /compute/v2.1/servers/b9e15d7c-e87e-45b6-a76b-9562f31480ec => generated 1316 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:18.864568 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-f1aba196-0745-4ff9-adfc-682a8646d260 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:18.865179 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-f1aba196-0745-4ff9-adfc-682a8646d260 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: b9e15d7c-e87e-45b6-a76b-9562f31480ec] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:45:18.871169 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f1aba196-0745-4ff9-adfc-682a8646d260 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:18.871613 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f1aba196-0745-4ff9-adfc-682a8646d260 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:18.872414 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f1aba196-0745-4ff9-adfc-682a8646d260 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:18.872845 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f1aba196-0745-4ff9-adfc-682a8646d260 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:18.999534 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-f1aba196-0745-4ff9-adfc-682a8646d260 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:19.007634 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-f1aba196-0745-4ff9-adfc-682a8646d260 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/b9e15d7c-e87e-45b6-a76b-9562f31480ec" status: 200 len: 1316 microversion: 2.1 time: 0.146730 Aug 27 04:45:19.008258 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 666/1336] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:45:18 2021] GET /compute/v2.1/servers/b9e15d7c-e87e-45b6-a76b-9562f31480ec => generated 1316 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:20.024635 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-d814b8d9-ad39-4129-a4c0-5c898b81569d tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:20.025253 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-d814b8d9-ad39-4129-a4c0-5c898b81569d tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: b9e15d7c-e87e-45b6-a76b-9562f31480ec] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:45:20.031595 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d814b8d9-ad39-4129-a4c0-5c898b81569d tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:20.032072 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d814b8d9-ad39-4129-a4c0-5c898b81569d tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:20.032855 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d814b8d9-ad39-4129-a4c0-5c898b81569d tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:20.033292 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d814b8d9-ad39-4129-a4c0-5c898b81569d tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:20.162327 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-d814b8d9-ad39-4129-a4c0-5c898b81569d tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:20.170751 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-d814b8d9-ad39-4129-a4c0-5c898b81569d tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/b9e15d7c-e87e-45b6-a76b-9562f31480ec" status: 200 len: 1316 microversion: 2.1 time: 0.149857 Aug 27 04:45:20.171470 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 671/1337] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:45:20 2021] GET /compute/v2.1/servers/b9e15d7c-e87e-45b6-a76b-9562f31480ec => generated 1316 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:21.157008 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [req-ea4d4d1b-6802-4e11-a24f-f465252f7602 req-28ac2c06-2bd9-4161-9f9a-da16e5a1aa95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9e15d7c-e87e-45b6-a76b-9562f31480ec", "name": "network-vif-plugged", "status": "completed", "tag": "92cbb9c8-5d2b-40f8-bba4-0e8c580aab29"}]} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:45:21.158642 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:45:21.158642 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: warnings.warn(msg) Aug 27 04:45:21.167710 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-ea4d4d1b-6802-4e11-a24f-f465252f7602 req-28ac2c06-2bd9-4161-9f9a-da16e5a1aa95 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:21.168190 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-ea4d4d1b-6802-4e11-a24f-f465252f7602 req-28ac2c06-2bd9-4161-9f9a-da16e5a1aa95 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:21.180211 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.compute.server_external_events [req-ea4d4d1b-6802-4e11-a24f-f465252f7602 req-28ac2c06-2bd9-4161-9f9a-da16e5a1aa95 service nova] Creating event network-vif-plugged:92cbb9c8-5d2b-40f8-bba4-0e8c580aab29 for instance b9e15d7c-e87e-45b6-a76b-9562f31480ec on hv-cinder-80403 Aug 27 04:45:21.186453 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [req-ea4d4d1b-6802-4e11-a24f-f465252f7602 req-28ac2c06-2bd9-4161-9f9a-da16e5a1aa95 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033203 Aug 27 04:45:21.187237 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 667/1338] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:45:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:45:21.188574 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-0911a840-cc63-4dca-8b37-25dc29a9d1cd tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:21.189267 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-0911a840-cc63-4dca-8b37-25dc29a9d1cd tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: b9e15d7c-e87e-45b6-a76b-9562f31480ec] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:45:21.195673 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0911a840-cc63-4dca-8b37-25dc29a9d1cd tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:21.196240 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0911a840-cc63-4dca-8b37-25dc29a9d1cd tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:21.197072 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0911a840-cc63-4dca-8b37-25dc29a9d1cd tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:21.197574 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0911a840-cc63-4dca-8b37-25dc29a9d1cd tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:21.324148 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-0911a840-cc63-4dca-8b37-25dc29a9d1cd tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:21.331761 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-0911a840-cc63-4dca-8b37-25dc29a9d1cd tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/b9e15d7c-e87e-45b6-a76b-9562f31480ec" status: 200 len: 1316 microversion: 2.1 time: 0.147527 Aug 27 04:45:21.332380 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 672/1339] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:45:21 2021] GET /compute/v2.1/servers/b9e15d7c-e87e-45b6-a76b-9562f31480ec => generated 1316 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:45:22.348947 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-274d4ca3-ce76-4bd0-8112-afb677a2e9cb tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:22.349651 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-274d4ca3-ce76-4bd0-8112-afb677a2e9cb tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: b9e15d7c-e87e-45b6-a76b-9562f31480ec] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:45:22.356135 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-274d4ca3-ce76-4bd0-8112-afb677a2e9cb tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:22.356587 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-274d4ca3-ce76-4bd0-8112-afb677a2e9cb tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:22.357371 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-274d4ca3-ce76-4bd0-8112-afb677a2e9cb tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:22.357808 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-274d4ca3-ce76-4bd0-8112-afb677a2e9cb tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:22.490255 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-274d4ca3-ce76-4bd0-8112-afb677a2e9cb tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:22.497606 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-274d4ca3-ce76-4bd0-8112-afb677a2e9cb tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/b9e15d7c-e87e-45b6-a76b-9562f31480ec" status: 200 len: 1316 microversion: 2.1 time: 0.152614 Aug 27 04:45:22.498375 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 668/1340] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:45:22 2021] GET /compute/v2.1/servers/b9e15d7c-e87e-45b6-a76b-9562f31480ec => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:23.514102 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-4e346b0d-ca88-4b6f-8168-76116549eca7 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:23.514851 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-4e346b0d-ca88-4b6f-8168-76116549eca7 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: b9e15d7c-e87e-45b6-a76b-9562f31480ec] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:45:23.520799 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-4e346b0d-ca88-4b6f-8168-76116549eca7 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:23.521571 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-4e346b0d-ca88-4b6f-8168-76116549eca7 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:23.522661 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-4e346b0d-ca88-4b6f-8168-76116549eca7 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:23.523343 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-4e346b0d-ca88-4b6f-8168-76116549eca7 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:24.060806 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-4e346b0d-ca88-4b6f-8168-76116549eca7 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:24.069101 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-4e346b0d-ca88-4b6f-8168-76116549eca7 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/b9e15d7c-e87e-45b6-a76b-9562f31480ec" status: 200 len: 1506 microversion: 2.1 time: 0.557918 Aug 27 04:45:24.069679 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 673/1341] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:45:23 2021] GET /compute/v2.1/servers/b9e15d7c-e87e-45b6-a76b-9562f31480ec => generated 1506 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:45:24.085273 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-038bc1ae-eb0c-45bf-8bc1-6a03aaaa7f92 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9aae2dee-5bd3-4761-aefd-7452af1b8141"}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:45:24.086328 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-038bc1ae-eb0c-45bf-8bc1-6a03aaaa7f92 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: b9e15d7c-e87e-45b6-a76b-9562f31480ec] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:45:24.092143 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-038bc1ae-eb0c-45bf-8bc1-6a03aaaa7f92 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:24.092596 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-038bc1ae-eb0c-45bf-8bc1-6a03aaaa7f92 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:24.093380 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-038bc1ae-eb0c-45bf-8bc1-6a03aaaa7f92 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:24.093816 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-038bc1ae-eb0c-45bf-8bc1-6a03aaaa7f92 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:24.209124 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.wsgi [None req-038bc1ae-eb0c-45bf-8bc1-6a03aaaa7f92 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] HTTP exception thrown: Invalid volume: volume 9aae2dee-5bd3-4761-aefd-7452af1b8141 is already attached to instances: d0f2a3fe-d7cd-448c-bb23-256ac860f4ca Aug 27 04:45:24.209989 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-038bc1ae-eb0c-45bf-8bc1-6a03aaaa7f92 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Returning 400 to user: Invalid volume: volume 9aae2dee-5bd3-4761-aefd-7452af1b8141 is already attached to instances: d0f2a3fe-d7cd-448c-bb23-256ac860f4ca {{(pid=108970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:45:24.210938 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-038bc1ae-eb0c-45bf-8bc1-6a03aaaa7f92 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "POST /compute/v2.1/servers/b9e15d7c-e87e-45b6-a76b-9562f31480ec/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.129636 Aug 27 04:45:24.211723 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 669/1342] 10.222.0.53 () {60 vars in 1323 bytes} [Fri Aug 27 04:45:24 2021] POST /compute/v2.1/servers/b9e15d7c-e87e-45b6-a76b-9562f31480ec/os-volume_attachments => generated 174 bytes in 131 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:45:24.289447 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-db426d37-edaf-4b6d-95f5-753384cc440e tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:24.290136 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-db426d37-edaf-4b6d-95f5-753384cc440e tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: d0f2a3fe-d7cd-448c-bb23-256ac860f4ca] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:45:24.296689 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-db426d37-edaf-4b6d-95f5-753384cc440e tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:24.297774 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-db426d37-edaf-4b6d-95f5-753384cc440e tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:24.298117 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-db426d37-edaf-4b6d-95f5-753384cc440e tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:24.298609 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-db426d37-edaf-4b6d-95f5-753384cc440e tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:24.422197 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.objects.instance [None req-db426d37-edaf-4b6d-95f5-753384cc440e tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lazy-loading 'services' on Instance uuid d0f2a3fe-d7cd-448c-bb23-256ac860f4ca {{(pid=108971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:45:24.510601 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-db426d37-edaf-4b6d-95f5-753384cc440e tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "DELETE /compute/v2.1/servers/d0f2a3fe-d7cd-448c-bb23-256ac860f4ca/os-volume_attachments/9aae2dee-5bd3-4761-aefd-7452af1b8141" status: 202 len: 0 microversion: 2.1 time: 0.225465 Aug 27 04:45:24.511844 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 674/1343] 10.222.0.53 () {58 vars in 1416 bytes} [Fri Aug 27 04:45:24 2021] DELETE /compute/v2.1/servers/d0f2a3fe-d7cd-448c-bb23-256ac860f4ca/os-volume_attachments/9aae2dee-5bd3-4761-aefd-7452af1b8141 => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:45:24.519944 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-a3e0b7d0-2517-453c-bddd-40302bb5844c tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:24.521692 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-a3e0b7d0-2517-453c-bddd-40302bb5844c tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: d0f2a3fe-d7cd-448c-bb23-256ac860f4ca] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:45:24.530195 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a3e0b7d0-2517-453c-bddd-40302bb5844c tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:24.530786 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a3e0b7d0-2517-453c-bddd-40302bb5844c tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:24.531775 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a3e0b7d0-2517-453c-bddd-40302bb5844c tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:24.532430 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a3e0b7d0-2517-453c-bddd-40302bb5844c tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:24.564426 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-a3e0b7d0-2517-453c-bddd-40302bb5844c tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/d0f2a3fe-d7cd-448c-bb23-256ac860f4ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048261 Aug 27 04:45:24.565104 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 670/1344] 10.222.0.53 () {58 vars in 1302 bytes} [Fri Aug 27 04:45:24 2021] GET /compute/v2.1/servers/d0f2a3fe-d7cd-448c-bb23-256ac860f4ca/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:45:25.577129 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-eb22dcb3-4a96-429d-81ad-66d40e2aa63d tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:25.578210 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-eb22dcb3-4a96-429d-81ad-66d40e2aa63d tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: d0f2a3fe-d7cd-448c-bb23-256ac860f4ca] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:45:25.588829 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-eb22dcb3-4a96-429d-81ad-66d40e2aa63d tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:25.589370 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-eb22dcb3-4a96-429d-81ad-66d40e2aa63d tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:25.590415 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-eb22dcb3-4a96-429d-81ad-66d40e2aa63d tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:25.590925 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-eb22dcb3-4a96-429d-81ad-66d40e2aa63d tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:25.621550 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-eb22dcb3-4a96-429d-81ad-66d40e2aa63d tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/d0f2a3fe-d7cd-448c-bb23-256ac860f4ca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048480 Aug 27 04:45:25.622553 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 675/1345] 10.222.0.53 () {58 vars in 1302 bytes} [Fri Aug 27 04:45:25 2021] GET /compute/v2.1/servers/d0f2a3fe-d7cd-448c-bb23-256ac860f4ca/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:45:25.789441 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-faa39958-9f3e-41b3-b1cc-9567582c3f88 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1835682000", "imageRef": "9356e2fa-e55b-41d9-9ca4-53393f2d79fd", "flavorRef": "452", "networks": [{"uuid": "dd42b135-3593-4e98-b507-9f2c85ac4990"}]}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:45:25.845362 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.network.neutron [None req-faa39958-9f3e-41b3-b1cc-9567582c3f88 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] validate_networks() for [('dd42b135-3593-4e98-b507-9f2c85ac4990', None, None, None, None, None)] {{(pid=108970) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 04:45:26.487447 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.virt.hardware [None req-faa39958-9f3e-41b3-b1cc-9567582c3f88 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Flavor limits 0:0:0 {{(pid=108970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:45:26.488375 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.virt.hardware [None req-faa39958-9f3e-41b3-b1cc-9567582c3f88 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Image limits 0:0:0 {{(pid=108970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:45:26.489703 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.virt.hardware [None req-faa39958-9f3e-41b3-b1cc-9567582c3f88 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Flavor pref 0:0:0 {{(pid=108970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:45:26.491208 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.virt.hardware [None req-faa39958-9f3e-41b3-b1cc-9567582c3f88 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Image pref 0:0:0 {{(pid=108970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:45:26.491970 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.virt.hardware [None req-faa39958-9f3e-41b3-b1cc-9567582c3f88 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:45:26.511402 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-faa39958-9f3e-41b3-b1cc-9567582c3f88 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:26.512743 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-faa39958-9f3e-41b3-b1cc-9567582c3f88 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:26.513986 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-faa39958-9f3e-41b3-b1cc-9567582c3f88 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:26.514830 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-faa39958-9f3e-41b3-b1cc-9567582c3f88 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:26.538191 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.quota [None req-faa39958-9f3e-41b3-b1cc-9567582c3f88 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Getting quotas for project b020e4046e594b05a242175f3df4dec0. Resources: {'ram', 'cores', 'instances'} {{(pid=108970) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:45:26.545881 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.quota [None req-faa39958-9f3e-41b3-b1cc-9567582c3f88 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Getting quotas for user 652113b414e74a148274e5658612a528 and project b020e4046e594b05a242175f3df4dec0. Resources: {'ram', 'cores', 'instances'} {{(pid=108970) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:45:26.560127 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-faa39958-9f3e-41b3-b1cc-9567582c3f88 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Going to run 1 instances... {{(pid=108970) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 04:45:26.563085 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-faa39958-9f3e-41b3-b1cc-9567582c3f88 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: 838b77f4-569b-4f66-93f1-083fb5cb5eca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9356e2fa-e55b-41d9-9ca4-53393f2d79fd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 04:45:26.626523 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-faa39958-9f3e-41b3-b1cc-9567582c3f88 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.841001 Aug 27 04:45:26.627745 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 671/1346] 10.222.0.53 () {60 vars in 1147 bytes} [Fri Aug 27 04:45:25 2021] POST /compute/v2.1/servers => generated 380 bytes in 843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:45:26.639155 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-d223e67c-a889-4a62-9b2f-a622f7ef2f3f tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:26.639833 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-d223e67c-a889-4a62-9b2f-a622f7ef2f3f tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: 838b77f4-569b-4f66-93f1-083fb5cb5eca] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:45:26.726892 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-d223e67c-a889-4a62-9b2f-a622f7ef2f3f tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:26.737266 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-d223e67c-a889-4a62-9b2f-a622f7ef2f3f tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/838b77f4-569b-4f66-93f1-083fb5cb5eca" status: 200 len: 1218 microversion: 2.1 time: 0.102168 Aug 27 04:45:26.742968 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 676/1347] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:45:26 2021] GET /compute/v2.1/servers/838b77f4-569b-4f66-93f1-083fb5cb5eca => generated 1218 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:27.754519 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-2dd13fb4-7856-4769-8aba-5384e0aa5eba tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:27.755145 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-2dd13fb4-7856-4769-8aba-5384e0aa5eba tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: 838b77f4-569b-4f66-93f1-083fb5cb5eca] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:45:27.762119 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2dd13fb4-7856-4769-8aba-5384e0aa5eba tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:27.762605 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2dd13fb4-7856-4769-8aba-5384e0aa5eba tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:27.763389 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2dd13fb4-7856-4769-8aba-5384e0aa5eba tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:27.763833 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2dd13fb4-7856-4769-8aba-5384e0aa5eba tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:27.827373 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-2dd13fb4-7856-4769-8aba-5384e0aa5eba tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:27.834687 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-2dd13fb4-7856-4769-8aba-5384e0aa5eba tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/838b77f4-569b-4f66-93f1-083fb5cb5eca" status: 200 len: 1270 microversion: 2.1 time: 0.084038 Aug 27 04:45:27.835277 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 672/1348] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:45:27 2021] GET /compute/v2.1/servers/838b77f4-569b-4f66-93f1-083fb5cb5eca => generated 1270 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:28.852645 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-1b3fb2d5-eaac-4599-9bbc-66a9bc98c6f2 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:28.853409 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-1b3fb2d5-eaac-4599-9bbc-66a9bc98c6f2 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: 838b77f4-569b-4f66-93f1-083fb5cb5eca] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:45:28.863477 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1b3fb2d5-eaac-4599-9bbc-66a9bc98c6f2 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:28.869727 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1b3fb2d5-eaac-4599-9bbc-66a9bc98c6f2 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:28.870871 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1b3fb2d5-eaac-4599-9bbc-66a9bc98c6f2 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:28.871430 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1b3fb2d5-eaac-4599-9bbc-66a9bc98c6f2 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:29.235594 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-1b3fb2d5-eaac-4599-9bbc-66a9bc98c6f2 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:29.249742 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-1b3fb2d5-eaac-4599-9bbc-66a9bc98c6f2 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/838b77f4-569b-4f66-93f1-083fb5cb5eca" status: 200 len: 1318 microversion: 2.1 time: 0.401715 Aug 27 04:45:29.251333 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 677/1349] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:45:28 2021] GET /compute/v2.1/servers/838b77f4-569b-4f66-93f1-083fb5cb5eca => generated 1318 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:30.266415 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-53d53fc9-94a1-440b-a82f-23abb53fbf39 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:30.267667 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-53d53fc9-94a1-440b-a82f-23abb53fbf39 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: 838b77f4-569b-4f66-93f1-083fb5cb5eca] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:45:30.277799 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-53d53fc9-94a1-440b-a82f-23abb53fbf39 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:30.278805 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-53d53fc9-94a1-440b-a82f-23abb53fbf39 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:30.279616 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-53d53fc9-94a1-440b-a82f-23abb53fbf39 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:30.280093 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-53d53fc9-94a1-440b-a82f-23abb53fbf39 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:30.469764 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-53d53fc9-94a1-440b-a82f-23abb53fbf39 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:30.488219 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-53d53fc9-94a1-440b-a82f-23abb53fbf39 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/838b77f4-569b-4f66-93f1-083fb5cb5eca" status: 200 len: 1318 microversion: 2.1 time: 0.225340 Aug 27 04:45:30.488920 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 673/1350] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:45:30 2021] GET /compute/v2.1/servers/838b77f4-569b-4f66-93f1-083fb5cb5eca => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:30.783924 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [req-c9ba7e19-7d42-46e9-b314-6e18bd3e1f73 req-bd15a9e2-e4c9-48f6-ae8a-95cc268de23e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "838b77f4-569b-4f66-93f1-083fb5cb5eca", "tag": "ab2e3ac6-490e-4cc6-b0f2-52534543c6f3"}]} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:45:30.785532 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:45:30.785532 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: warnings.warn(msg) Aug 27 04:45:30.810527 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-c9ba7e19-7d42-46e9-b314-6e18bd3e1f73 req-bd15a9e2-e4c9-48f6-ae8a-95cc268de23e service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:30.811312 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-c9ba7e19-7d42-46e9-b314-6e18bd3e1f73 req-bd15a9e2-e4c9-48f6-ae8a-95cc268de23e service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:30.831566 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.compute.server_external_events [req-c9ba7e19-7d42-46e9-b314-6e18bd3e1f73 req-bd15a9e2-e4c9-48f6-ae8a-95cc268de23e service nova] Creating event network-changed:ab2e3ac6-490e-4cc6-b0f2-52534543c6f3 for instance 838b77f4-569b-4f66-93f1-083fb5cb5eca on hv-cinder-80403 Aug 27 04:45:30.839044 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [req-c9ba7e19-7d42-46e9-b314-6e18bd3e1f73 req-bd15a9e2-e4c9-48f6-ae8a-95cc268de23e service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058509 Aug 27 04:45:30.841100 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 678/1351] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:45:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:45:31.506699 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-ba65d60f-4488-4bf7-a884-fa97b4c5367a tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:31.507304 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-ba65d60f-4488-4bf7-a884-fa97b4c5367a tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: 838b77f4-569b-4f66-93f1-083fb5cb5eca] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:45:31.516541 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ba65d60f-4488-4bf7-a884-fa97b4c5367a tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:31.517022 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ba65d60f-4488-4bf7-a884-fa97b4c5367a tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:31.517855 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ba65d60f-4488-4bf7-a884-fa97b4c5367a tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:31.518307 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ba65d60f-4488-4bf7-a884-fa97b4c5367a tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:31.701028 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-ba65d60f-4488-4bf7-a884-fa97b4c5367a tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:31.717583 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-ba65d60f-4488-4bf7-a884-fa97b4c5367a tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/838b77f4-569b-4f66-93f1-083fb5cb5eca" status: 200 len: 1318 microversion: 2.1 time: 0.215437 Aug 27 04:45:31.718531 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 674/1352] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:45:31 2021] GET /compute/v2.1/servers/838b77f4-569b-4f66-93f1-083fb5cb5eca => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:32.741904 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-f24c737a-a2db-49a0-88cf-32c0ddd991a4 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:32.742840 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-f24c737a-a2db-49a0-88cf-32c0ddd991a4 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: 838b77f4-569b-4f66-93f1-083fb5cb5eca] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:45:32.749109 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f24c737a-a2db-49a0-88cf-32c0ddd991a4 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:32.749655 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f24c737a-a2db-49a0-88cf-32c0ddd991a4 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:32.750495 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f24c737a-a2db-49a0-88cf-32c0ddd991a4 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:32.751006 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f24c737a-a2db-49a0-88cf-32c0ddd991a4 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:32.889505 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-f24c737a-a2db-49a0-88cf-32c0ddd991a4 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:32.897743 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-f24c737a-a2db-49a0-88cf-32c0ddd991a4 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/838b77f4-569b-4f66-93f1-083fb5cb5eca" status: 200 len: 1318 microversion: 2.1 time: 0.160437 Aug 27 04:45:32.898665 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 679/1353] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:45:32 2021] GET /compute/v2.1/servers/838b77f4-569b-4f66-93f1-083fb5cb5eca => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:33.915783 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-88b2972e-2f9b-438d-8109-77adbb9006e2 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:33.917414 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-88b2972e-2f9b-438d-8109-77adbb9006e2 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: 838b77f4-569b-4f66-93f1-083fb5cb5eca] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:45:33.926918 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-88b2972e-2f9b-438d-8109-77adbb9006e2 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:33.928288 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-88b2972e-2f9b-438d-8109-77adbb9006e2 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:33.931142 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-88b2972e-2f9b-438d-8109-77adbb9006e2 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:33.931661 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-88b2972e-2f9b-438d-8109-77adbb9006e2 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:34.145704 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-88b2972e-2f9b-438d-8109-77adbb9006e2 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:34.158809 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-88b2972e-2f9b-438d-8109-77adbb9006e2 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/838b77f4-569b-4f66-93f1-083fb5cb5eca" status: 200 len: 1318 microversion: 2.1 time: 0.247266 Aug 27 04:45:34.170956 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 675/1354] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:45:33 2021] GET /compute/v2.1/servers/838b77f4-569b-4f66-93f1-083fb5cb5eca => generated 1318 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:45:34.592292 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-4e0ac3b7-f794-4ad9-949c-60f393352db5 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Action: 'create', calling method: .version_select at 0x7f20786b0160>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-725197301"}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:45:34.617029 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.quota [None req-4e0ac3b7-f794-4ad9-949c-60f393352db5 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Getting quotas for project 268453b6c33d4cc0a6486da778b00f9b. Resources: {'key_pairs'} {{(pid=108971) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:45:34.621005 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.quota [None req-4e0ac3b7-f794-4ad9-949c-60f393352db5 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Getting quotas for user c5af28c28d4044fe8b57978dd4b775e3 and project 268453b6c33d4cc0a6486da778b00f9b. Resources: {'key_pairs'} {{(pid=108971) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:45:35.039142 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.quota [None req-4e0ac3b7-f794-4ad9-949c-60f393352db5 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Getting quotas for project 268453b6c33d4cc0a6486da778b00f9b. Resources: {'key_pairs'} {{(pid=108971) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:45:35.042785 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.quota [None req-4e0ac3b7-f794-4ad9-949c-60f393352db5 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Getting quotas for user c5af28c28d4044fe8b57978dd4b775e3 and project 268453b6c33d4cc0a6486da778b00f9b. Resources: {'key_pairs'} {{(pid=108971) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:45:35.056917 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-4e0ac3b7-f794-4ad9-949c-60f393352db5 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.668000 Aug 27 04:45:35.057540 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 680/1355] 10.222.0.53 () {60 vars in 1158 bytes} [Fri Aug 27 04:45:34 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:35.177756 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-2df86358-6057-456d-8b54-cf777105c437 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:35.178483 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-2df86358-6057-456d-8b54-cf777105c437 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: 838b77f4-569b-4f66-93f1-083fb5cb5eca] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:45:35.187617 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2df86358-6057-456d-8b54-cf777105c437 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:35.188461 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2df86358-6057-456d-8b54-cf777105c437 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:35.189731 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2df86358-6057-456d-8b54-cf777105c437 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:35.190466 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2df86358-6057-456d-8b54-cf777105c437 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:35.346559 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-2df86358-6057-456d-8b54-cf777105c437 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:35.354901 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-2df86358-6057-456d-8b54-cf777105c437 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/838b77f4-569b-4f66-93f1-083fb5cb5eca" status: 200 len: 1318 microversion: 2.1 time: 0.181793 Aug 27 04:45:35.355713 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 676/1356] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:45:35 2021] GET /compute/v2.1/servers/838b77f4-569b-4f66-93f1-083fb5cb5eca => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:36.371339 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-16b53881-442d-4165-bfad-235bb8397c1e tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:36.371961 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-16b53881-442d-4165-bfad-235bb8397c1e tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: 838b77f4-569b-4f66-93f1-083fb5cb5eca] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:45:36.379190 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-16b53881-442d-4165-bfad-235bb8397c1e tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:36.379635 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-16b53881-442d-4165-bfad-235bb8397c1e tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:36.381053 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-16b53881-442d-4165-bfad-235bb8397c1e tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:36.381390 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-16b53881-442d-4165-bfad-235bb8397c1e tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:36.575977 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-16b53881-442d-4165-bfad-235bb8397c1e tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:36.585842 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-16b53881-442d-4165-bfad-235bb8397c1e tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/838b77f4-569b-4f66-93f1-083fb5cb5eca" status: 200 len: 1318 microversion: 2.1 time: 0.218125 Aug 27 04:45:36.587137 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 681/1357] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:45:36 2021] GET /compute/v2.1/servers/838b77f4-569b-4f66-93f1-083fb5cb5eca => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:37.612771 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-129818ca-01e8-41de-879e-8ac1272a8915 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:37.613839 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-129818ca-01e8-41de-879e-8ac1272a8915 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: 838b77f4-569b-4f66-93f1-083fb5cb5eca] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:45:37.622656 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-129818ca-01e8-41de-879e-8ac1272a8915 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:37.623327 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-129818ca-01e8-41de-879e-8ac1272a8915 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:37.624224 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-129818ca-01e8-41de-879e-8ac1272a8915 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:37.624735 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-129818ca-01e8-41de-879e-8ac1272a8915 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:37.763087 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-129818ca-01e8-41de-879e-8ac1272a8915 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:37.774047 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-129818ca-01e8-41de-879e-8ac1272a8915 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/838b77f4-569b-4f66-93f1-083fb5cb5eca" status: 200 len: 1318 microversion: 2.1 time: 0.167733 Aug 27 04:45:37.774646 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 677/1358] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:45:37 2021] GET /compute/v2.1/servers/838b77f4-569b-4f66-93f1-083fb5cb5eca => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:38.790499 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-b9f16f03-044d-4d09-87b6-1c1516dbeda0 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:38.791112 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-b9f16f03-044d-4d09-87b6-1c1516dbeda0 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: 838b77f4-569b-4f66-93f1-083fb5cb5eca] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:45:38.797088 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b9f16f03-044d-4d09-87b6-1c1516dbeda0 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:38.797565 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b9f16f03-044d-4d09-87b6-1c1516dbeda0 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:38.798350 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b9f16f03-044d-4d09-87b6-1c1516dbeda0 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:38.798795 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b9f16f03-044d-4d09-87b6-1c1516dbeda0 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:38.921237 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-b9f16f03-044d-4d09-87b6-1c1516dbeda0 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:38.928927 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-b9f16f03-044d-4d09-87b6-1c1516dbeda0 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/838b77f4-569b-4f66-93f1-083fb5cb5eca" status: 200 len: 1318 microversion: 2.1 time: 0.142162 Aug 27 04:45:38.929522 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 682/1359] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:45:38 2021] GET /compute/v2.1/servers/838b77f4-569b-4f66-93f1-083fb5cb5eca => generated 1318 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:39.243354 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [req-98358507-e1ae-48fb-915f-690c04d17fdb req-e9b6411b-f9c5-468b-b3d1-113d3b15c6d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "838b77f4-569b-4f66-93f1-083fb5cb5eca", "name": "network-vif-plugged", "status": "completed", "tag": "ab2e3ac6-490e-4cc6-b0f2-52534543c6f3"}]} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:45:39.245713 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:45:39.245713 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: warnings.warn(msg) Aug 27 04:45:39.254504 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-98358507-e1ae-48fb-915f-690c04d17fdb req-e9b6411b-f9c5-468b-b3d1-113d3b15c6d2 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:39.254960 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-98358507-e1ae-48fb-915f-690c04d17fdb req-e9b6411b-f9c5-468b-b3d1-113d3b15c6d2 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:39.266676 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.compute.server_external_events [req-98358507-e1ae-48fb-915f-690c04d17fdb req-e9b6411b-f9c5-468b-b3d1-113d3b15c6d2 service nova] Creating event network-vif-plugged:ab2e3ac6-490e-4cc6-b0f2-52534543c6f3 for instance 838b77f4-569b-4f66-93f1-083fb5cb5eca on hv-cinder-80403 Aug 27 04:45:39.271959 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [req-98358507-e1ae-48fb-915f-690c04d17fdb req-e9b6411b-f9c5-468b-b3d1-113d3b15c6d2 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034222 Aug 27 04:45:39.273087 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 678/1360] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:45:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:45:39.946984 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-7b00e2da-6da2-48e1-b63b-a1b398e46fc9 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:39.947580 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-7b00e2da-6da2-48e1-b63b-a1b398e46fc9 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: 838b77f4-569b-4f66-93f1-083fb5cb5eca] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:45:39.953530 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7b00e2da-6da2-48e1-b63b-a1b398e46fc9 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:39.953977 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7b00e2da-6da2-48e1-b63b-a1b398e46fc9 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:39.954749 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7b00e2da-6da2-48e1-b63b-a1b398e46fc9 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:39.955189 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7b00e2da-6da2-48e1-b63b-a1b398e46fc9 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:40.079265 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-7b00e2da-6da2-48e1-b63b-a1b398e46fc9 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:40.087402 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-7b00e2da-6da2-48e1-b63b-a1b398e46fc9 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/838b77f4-569b-4f66-93f1-083fb5cb5eca" status: 200 len: 1318 microversion: 2.1 time: 0.145246 Aug 27 04:45:40.087964 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 683/1361] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:45:39 2021] GET /compute/v2.1/servers/838b77f4-569b-4f66-93f1-083fb5cb5eca => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:41.106074 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-a0084b7c-f0ab-4d18-8b80-5e1ed343874e tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:41.106955 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-a0084b7c-f0ab-4d18-8b80-5e1ed343874e tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: 838b77f4-569b-4f66-93f1-083fb5cb5eca] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:45:41.113207 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a0084b7c-f0ab-4d18-8b80-5e1ed343874e tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:41.113658 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a0084b7c-f0ab-4d18-8b80-5e1ed343874e tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:41.114437 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a0084b7c-f0ab-4d18-8b80-5e1ed343874e tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:41.114882 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-a0084b7c-f0ab-4d18-8b80-5e1ed343874e tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:41.243261 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-a0084b7c-f0ab-4d18-8b80-5e1ed343874e tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:41.250955 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-a0084b7c-f0ab-4d18-8b80-5e1ed343874e tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/838b77f4-569b-4f66-93f1-083fb5cb5eca" status: 200 len: 1318 microversion: 2.1 time: 0.149245 Aug 27 04:45:41.251523 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 679/1362] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:45:41 2021] GET /compute/v2.1/servers/838b77f4-569b-4f66-93f1-083fb5cb5eca => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:42.267589 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-6a7548d8-2801-4433-9835-bc124d6727f0 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:42.268244 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-6a7548d8-2801-4433-9835-bc124d6727f0 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: 838b77f4-569b-4f66-93f1-083fb5cb5eca] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:45:42.274875 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6a7548d8-2801-4433-9835-bc124d6727f0 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:42.275326 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6a7548d8-2801-4433-9835-bc124d6727f0 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:42.276135 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6a7548d8-2801-4433-9835-bc124d6727f0 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:42.276578 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6a7548d8-2801-4433-9835-bc124d6727f0 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:42.398460 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-6a7548d8-2801-4433-9835-bc124d6727f0 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:42.405864 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-6a7548d8-2801-4433-9835-bc124d6727f0 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/838b77f4-569b-4f66-93f1-083fb5cb5eca" status: 200 len: 1508 microversion: 2.1 time: 0.141985 Aug 27 04:45:42.406426 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 684/1363] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:45:42 2021] GET /compute/v2.1/servers/838b77f4-569b-4f66-93f1-083fb5cb5eca => generated 1508 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:43.733429 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-c52fe231-6d4b-4299-8980-dde4cff1a65c tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0eabe18a-e867-448d-ba43-b72723be8f1f"}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:45:43.734500 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-c52fe231-6d4b-4299-8980-dde4cff1a65c tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: 838b77f4-569b-4f66-93f1-083fb5cb5eca] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:45:43.741055 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-c52fe231-6d4b-4299-8980-dde4cff1a65c tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:43.741508 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-c52fe231-6d4b-4299-8980-dde4cff1a65c tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:43.742269 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-c52fe231-6d4b-4299-8980-dde4cff1a65c tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:43.742705 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-c52fe231-6d4b-4299-8980-dde4cff1a65c tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:44.010457 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-c52fe231-6d4b-4299-8980-dde4cff1a65c tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "POST /compute/v2.1/servers/838b77f4-569b-4f66-93f1-083fb5cb5eca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280673 Aug 27 04:45:44.011074 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 680/1364] 10.222.0.53 () {60 vars in 1323 bytes} [Fri Aug 27 04:45:43 2021] POST /compute/v2.1/servers/838b77f4-569b-4f66-93f1-083fb5cb5eca/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:45:51.546140 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-06f107a8-1aa8-4bb6-8989-43e3d416c877 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0eabe18a-e867-448d-ba43-b72723be8f1f"}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:45:51.547162 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-06f107a8-1aa8-4bb6-8989-43e3d416c877 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: 838b77f4-569b-4f66-93f1-083fb5cb5eca] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:45:51.553755 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-06f107a8-1aa8-4bb6-8989-43e3d416c877 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:51.554214 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-06f107a8-1aa8-4bb6-8989-43e3d416c877 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:51.555002 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-06f107a8-1aa8-4bb6-8989-43e3d416c877 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:51.555444 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-06f107a8-1aa8-4bb6-8989-43e3d416c877 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:51.640863 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.wsgi [None req-06f107a8-1aa8-4bb6-8989-43e3d416c877 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] HTTP exception thrown: Invalid volume: volume 0eabe18a-e867-448d-ba43-b72723be8f1f is already attached to instances: 838b77f4-569b-4f66-93f1-083fb5cb5eca Aug 27 04:45:51.641491 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-06f107a8-1aa8-4bb6-8989-43e3d416c877 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Returning 400 to user: Invalid volume: volume 0eabe18a-e867-448d-ba43-b72723be8f1f is already attached to instances: 838b77f4-569b-4f66-93f1-083fb5cb5eca {{(pid=108971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:45:51.642330 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-06f107a8-1aa8-4bb6-8989-43e3d416c877 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "POST /compute/v2.1/servers/838b77f4-569b-4f66-93f1-083fb5cb5eca/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100227 Aug 27 04:45:51.642882 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 685/1365] 10.222.0.53 () {60 vars in 1323 bytes} [Fri Aug 27 04:45:51 2021] POST /compute/v2.1/servers/838b77f4-569b-4f66-93f1-083fb5cb5eca/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:45:51.712579 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-e95ce588-a12a-48c3-bf80-81f39b77e509 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:51.713164 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-e95ce588-a12a-48c3-bf80-81f39b77e509 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: 838b77f4-569b-4f66-93f1-083fb5cb5eca] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:45:51.720036 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e95ce588-a12a-48c3-bf80-81f39b77e509 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:51.720502 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e95ce588-a12a-48c3-bf80-81f39b77e509 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:51.721277 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e95ce588-a12a-48c3-bf80-81f39b77e509 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:51.721729 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e95ce588-a12a-48c3-bf80-81f39b77e509 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:51.801176 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.objects.instance [None req-e95ce588-a12a-48c3-bf80-81f39b77e509 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lazy-loading 'services' on Instance uuid 838b77f4-569b-4f66-93f1-083fb5cb5eca {{(pid=108970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:45:51.865995 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-e95ce588-a12a-48c3-bf80-81f39b77e509 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "DELETE /compute/v2.1/servers/838b77f4-569b-4f66-93f1-083fb5cb5eca/os-volume_attachments/0eabe18a-e867-448d-ba43-b72723be8f1f" status: 202 len: 0 microversion: 2.1 time: 0.156667 Aug 27 04:45:51.866761 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 681/1366] 10.222.0.53 () {58 vars in 1416 bytes} [Fri Aug 27 04:45:51 2021] DELETE /compute/v2.1/servers/838b77f4-569b-4f66-93f1-083fb5cb5eca/os-volume_attachments/0eabe18a-e867-448d-ba43-b72723be8f1f => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:45:51.874891 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-90e67a9c-b1fc-4971-8437-bb0a659eac79 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:51.876081 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-90e67a9c-b1fc-4971-8437-bb0a659eac79 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: 838b77f4-569b-4f66-93f1-083fb5cb5eca] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:45:51.883035 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-90e67a9c-b1fc-4971-8437-bb0a659eac79 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:51.883597 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-90e67a9c-b1fc-4971-8437-bb0a659eac79 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:51.884676 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-90e67a9c-b1fc-4971-8437-bb0a659eac79 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:51.885138 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-90e67a9c-b1fc-4971-8437-bb0a659eac79 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:51.915869 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-90e67a9c-b1fc-4971-8437-bb0a659eac79 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/838b77f4-569b-4f66-93f1-083fb5cb5eca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044700 Aug 27 04:45:51.916474 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 686/1367] 10.222.0.53 () {58 vars in 1302 bytes} [Fri Aug 27 04:45:51 2021] GET /compute/v2.1/servers/838b77f4-569b-4f66-93f1-083fb5cb5eca/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:45:52.927653 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-1f61d5e9-f915-4412-b4dc-d0dd407f6a2f tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:52.928755 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-1f61d5e9-f915-4412-b4dc-d0dd407f6a2f tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: 838b77f4-569b-4f66-93f1-083fb5cb5eca] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:45:52.935381 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1f61d5e9-f915-4412-b4dc-d0dd407f6a2f tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:52.935825 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1f61d5e9-f915-4412-b4dc-d0dd407f6a2f tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:52.936630 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1f61d5e9-f915-4412-b4dc-d0dd407f6a2f tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:52.937119 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1f61d5e9-f915-4412-b4dc-d0dd407f6a2f tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:52.968785 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-1f61d5e9-f915-4412-b4dc-d0dd407f6a2f tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/838b77f4-569b-4f66-93f1-083fb5cb5eca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045342 Aug 27 04:45:52.969352 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 682/1368] 10.222.0.53 () {58 vars in 1302 bytes} [Fri Aug 27 04:45:52 2021] GET /compute/v2.1/servers/838b77f4-569b-4f66-93f1-083fb5cb5eca/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:45:53.132697 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-706b7359-4912-4276-8597-a73383314322 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1832860531", "imageRef": "9356e2fa-e55b-41d9-9ca4-53393f2d79fd", "flavorRef": "452", "networks": [{"uuid": "dd42b135-3593-4e98-b507-9f2c85ac4990"}]}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:45:53.183897 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.network.neutron [None req-706b7359-4912-4276-8597-a73383314322 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] validate_networks() for [('dd42b135-3593-4e98-b507-9f2c85ac4990', None, None, None, None, None)] {{(pid=108971) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 04:45:53.553418 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.virt.hardware [None req-706b7359-4912-4276-8597-a73383314322 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Flavor limits 0:0:0 {{(pid=108971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:45:53.553841 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.virt.hardware [None req-706b7359-4912-4276-8597-a73383314322 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Image limits 0:0:0 {{(pid=108971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:45:53.554318 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.virt.hardware [None req-706b7359-4912-4276-8597-a73383314322 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Flavor pref 0:0:0 {{(pid=108971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:45:53.554728 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.virt.hardware [None req-706b7359-4912-4276-8597-a73383314322 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Image pref 0:0:0 {{(pid=108971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:45:53.555170 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.virt.hardware [None req-706b7359-4912-4276-8597-a73383314322 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:45:53.564103 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-706b7359-4912-4276-8597-a73383314322 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:53.564551 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-706b7359-4912-4276-8597-a73383314322 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:53.565361 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-706b7359-4912-4276-8597-a73383314322 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:53.565803 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-706b7359-4912-4276-8597-a73383314322 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:53.583957 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.quota [None req-706b7359-4912-4276-8597-a73383314322 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Getting quotas for project b020e4046e594b05a242175f3df4dec0. Resources: {'ram', 'cores', 'instances'} {{(pid=108971) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:45:53.587953 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.quota [None req-706b7359-4912-4276-8597-a73383314322 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Getting quotas for user 652113b414e74a148274e5658612a528 and project b020e4046e594b05a242175f3df4dec0. Resources: {'ram', 'cores', 'instances'} {{(pid=108971) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:45:53.598899 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-706b7359-4912-4276-8597-a73383314322 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Going to run 1 instances... {{(pid=108971) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 04:45:53.601337 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-706b7359-4912-4276-8597-a73383314322 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: 9353ffc8-af99-478a-84a7-b3d3c94aa2b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9356e2fa-e55b-41d9-9ca4-53393f2d79fd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 04:45:53.644583 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-706b7359-4912-4276-8597-a73383314322 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.515735 Aug 27 04:45:53.645457 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 687/1369] 10.222.0.53 () {60 vars in 1147 bytes} [Fri Aug 27 04:45:53 2021] POST /compute/v2.1/servers => generated 380 bytes in 517 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:45:53.655506 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-79f00630-4d57-412d-8901-76b32fb6f3a3 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:53.656152 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-79f00630-4d57-412d-8901-76b32fb6f3a3 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: 9353ffc8-af99-478a-84a7-b3d3c94aa2b5] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:45:53.710666 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-79f00630-4d57-412d-8901-76b32fb6f3a3 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:53.717918 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-79f00630-4d57-412d-8901-76b32fb6f3a3 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/9353ffc8-af99-478a-84a7-b3d3c94aa2b5" status: 200 len: 1218 microversion: 2.1 time: 0.066042 Aug 27 04:45:53.718489 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 683/1370] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:45:53 2021] GET /compute/v2.1/servers/9353ffc8-af99-478a-84a7-b3d3c94aa2b5 => generated 1218 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:54.735097 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-53e534c3-baf7-4ff3-b69a-0b8e8db50ac6 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:54.735820 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-53e534c3-baf7-4ff3-b69a-0b8e8db50ac6 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: 9353ffc8-af99-478a-84a7-b3d3c94aa2b5] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:45:54.742561 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-53e534c3-baf7-4ff3-b69a-0b8e8db50ac6 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:54.743104 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-53e534c3-baf7-4ff3-b69a-0b8e8db50ac6 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:54.743958 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-53e534c3-baf7-4ff3-b69a-0b8e8db50ac6 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:54.744488 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-53e534c3-baf7-4ff3-b69a-0b8e8db50ac6 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:54.822347 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-53e534c3-baf7-4ff3-b69a-0b8e8db50ac6 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:54.829343 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-53e534c3-baf7-4ff3-b69a-0b8e8db50ac6 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/9353ffc8-af99-478a-84a7-b3d3c94aa2b5" status: 200 len: 1288 microversion: 2.1 time: 0.098006 Aug 27 04:45:54.830108 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 688/1371] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:45:54 2021] GET /compute/v2.1/servers/9353ffc8-af99-478a-84a7-b3d3c94aa2b5 => generated 1288 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:55.850944 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-f180163a-95a4-405c-87ff-b1844fc41d28 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:55.852097 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-f180163a-95a4-405c-87ff-b1844fc41d28 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: 9353ffc8-af99-478a-84a7-b3d3c94aa2b5] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:45:55.860139 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f180163a-95a4-405c-87ff-b1844fc41d28 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:55.860596 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f180163a-95a4-405c-87ff-b1844fc41d28 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:55.861558 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f180163a-95a4-405c-87ff-b1844fc41d28 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:55.862167 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f180163a-95a4-405c-87ff-b1844fc41d28 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:56.001469 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-f180163a-95a4-405c-87ff-b1844fc41d28 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:56.008591 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-f180163a-95a4-405c-87ff-b1844fc41d28 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/9353ffc8-af99-478a-84a7-b3d3c94aa2b5" status: 200 len: 1318 microversion: 2.1 time: 0.164738 Aug 27 04:45:56.009170 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 684/1372] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:45:55 2021] GET /compute/v2.1/servers/9353ffc8-af99-478a-84a7-b3d3c94aa2b5 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:56.041288 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [req-ba559cc8-f488-47cf-b59a-1cf3bdc0dd24 req-a0868770-50d7-4324-a58b-74d0a5733945 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9353ffc8-af99-478a-84a7-b3d3c94aa2b5", "tag": "feb51b59-4be7-4f3e-a070-ba91d8fbaadc"}]} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:45:56.043694 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:45:56.043694 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: warnings.warn(msg) Aug 27 04:45:56.051599 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-ba559cc8-f488-47cf-b59a-1cf3bdc0dd24 req-a0868770-50d7-4324-a58b-74d0a5733945 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:56.052188 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-ba559cc8-f488-47cf-b59a-1cf3bdc0dd24 req-a0868770-50d7-4324-a58b-74d0a5733945 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:56.063122 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.compute.server_external_events [req-ba559cc8-f488-47cf-b59a-1cf3bdc0dd24 req-a0868770-50d7-4324-a58b-74d0a5733945 service nova] Creating event network-changed:feb51b59-4be7-4f3e-a070-ba91d8fbaadc for instance 9353ffc8-af99-478a-84a7-b3d3c94aa2b5 on hv-cinder-80403 Aug 27 04:45:56.069247 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [req-ba559cc8-f488-47cf-b59a-1cf3bdc0dd24 req-a0868770-50d7-4324-a58b-74d0a5733945 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032709 Aug 27 04:45:56.072758 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 689/1373] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:45:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:45:57.030647 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-ba99808b-f074-4d20-a724-c603081ca3f8 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:57.031259 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-ba99808b-f074-4d20-a724-c603081ca3f8 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: 9353ffc8-af99-478a-84a7-b3d3c94aa2b5] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:45:57.037971 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ba99808b-f074-4d20-a724-c603081ca3f8 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:57.038414 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ba99808b-f074-4d20-a724-c603081ca3f8 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:57.039182 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ba99808b-f074-4d20-a724-c603081ca3f8 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:57.039614 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ba99808b-f074-4d20-a724-c603081ca3f8 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:57.191618 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-ba99808b-f074-4d20-a724-c603081ca3f8 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:57.199547 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-ba99808b-f074-4d20-a724-c603081ca3f8 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/9353ffc8-af99-478a-84a7-b3d3c94aa2b5" status: 200 len: 1318 microversion: 2.1 time: 0.172764 Aug 27 04:45:57.200154 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 685/1374] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:45:57 2021] GET /compute/v2.1/servers/9353ffc8-af99-478a-84a7-b3d3c94aa2b5 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:45:58.217878 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-f3359e43-b77e-401a-bb51-6f7aee704389 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:58.218580 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-f3359e43-b77e-401a-bb51-6f7aee704389 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: 9353ffc8-af99-478a-84a7-b3d3c94aa2b5] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:45:58.224816 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f3359e43-b77e-401a-bb51-6f7aee704389 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:58.225265 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f3359e43-b77e-401a-bb51-6f7aee704389 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:58.226036 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f3359e43-b77e-401a-bb51-6f7aee704389 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:58.226473 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f3359e43-b77e-401a-bb51-6f7aee704389 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:58.354175 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-f3359e43-b77e-401a-bb51-6f7aee704389 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:58.361648 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-f3359e43-b77e-401a-bb51-6f7aee704389 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/9353ffc8-af99-478a-84a7-b3d3c94aa2b5" status: 200 len: 1318 microversion: 2.1 time: 0.147903 Aug 27 04:45:58.362245 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 690/1375] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:45:58 2021] GET /compute/v2.1/servers/9353ffc8-af99-478a-84a7-b3d3c94aa2b5 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:45:59.378533 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-65ce0527-2d9f-4641-837e-a8941f3683aa tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:45:59.379136 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-65ce0527-2d9f-4641-837e-a8941f3683aa tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: 9353ffc8-af99-478a-84a7-b3d3c94aa2b5] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:45:59.385539 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-65ce0527-2d9f-4641-837e-a8941f3683aa tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:59.385983 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-65ce0527-2d9f-4641-837e-a8941f3683aa tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:59.386770 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-65ce0527-2d9f-4641-837e-a8941f3683aa tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:45:59.387205 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-65ce0527-2d9f-4641-837e-a8941f3683aa tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:45:59.511841 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-65ce0527-2d9f-4641-837e-a8941f3683aa tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:45:59.519688 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-65ce0527-2d9f-4641-837e-a8941f3683aa tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/9353ffc8-af99-478a-84a7-b3d3c94aa2b5" status: 200 len: 1318 microversion: 2.1 time: 0.144726 Aug 27 04:45:59.520390 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 686/1376] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:45:59 2021] GET /compute/v2.1/servers/9353ffc8-af99-478a-84a7-b3d3c94aa2b5 => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:00.537158 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-0043b1ff-0b18-4d8c-aa4e-9b2e870cb81d tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:00.537824 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-0043b1ff-0b18-4d8c-aa4e-9b2e870cb81d tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: 9353ffc8-af99-478a-84a7-b3d3c94aa2b5] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:46:00.543947 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0043b1ff-0b18-4d8c-aa4e-9b2e870cb81d tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:00.544421 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0043b1ff-0b18-4d8c-aa4e-9b2e870cb81d tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:00.545201 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0043b1ff-0b18-4d8c-aa4e-9b2e870cb81d tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:00.545636 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0043b1ff-0b18-4d8c-aa4e-9b2e870cb81d tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:00.945144 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-0043b1ff-0b18-4d8c-aa4e-9b2e870cb81d tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:00.952623 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-0043b1ff-0b18-4d8c-aa4e-9b2e870cb81d tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/9353ffc8-af99-478a-84a7-b3d3c94aa2b5" status: 200 len: 1318 microversion: 2.1 time: 0.419752 Aug 27 04:46:00.953193 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 691/1377] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:46:00 2021] GET /compute/v2.1/servers/9353ffc8-af99-478a-84a7-b3d3c94aa2b5 => generated 1318 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:01.970200 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-fe7477c5-50e8-4d62-a520-51614513215e tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:01.970865 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-fe7477c5-50e8-4d62-a520-51614513215e tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: 9353ffc8-af99-478a-84a7-b3d3c94aa2b5] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:46:01.977022 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fe7477c5-50e8-4d62-a520-51614513215e tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:01.977463 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fe7477c5-50e8-4d62-a520-51614513215e tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:01.978233 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fe7477c5-50e8-4d62-a520-51614513215e tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:01.978919 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fe7477c5-50e8-4d62-a520-51614513215e tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:02.120141 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-fe7477c5-50e8-4d62-a520-51614513215e tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:02.128655 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-fe7477c5-50e8-4d62-a520-51614513215e tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/9353ffc8-af99-478a-84a7-b3d3c94aa2b5" status: 200 len: 1318 microversion: 2.1 time: 0.162047 Aug 27 04:46:02.129239 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 687/1378] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:46:01 2021] GET /compute/v2.1/servers/9353ffc8-af99-478a-84a7-b3d3c94aa2b5 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:46:03.146809 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-2e0275ac-5e97-4d90-b5f5-1352a5700aca tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:03.147401 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-2e0275ac-5e97-4d90-b5f5-1352a5700aca tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: 9353ffc8-af99-478a-84a7-b3d3c94aa2b5] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:46:03.153954 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-2e0275ac-5e97-4d90-b5f5-1352a5700aca tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:03.154416 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-2e0275ac-5e97-4d90-b5f5-1352a5700aca tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:03.155191 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-2e0275ac-5e97-4d90-b5f5-1352a5700aca tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:03.155619 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-2e0275ac-5e97-4d90-b5f5-1352a5700aca tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:03.283971 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-2e0275ac-5e97-4d90-b5f5-1352a5700aca tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:03.296832 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-2e0275ac-5e97-4d90-b5f5-1352a5700aca tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/9353ffc8-af99-478a-84a7-b3d3c94aa2b5" status: 200 len: 1318 microversion: 2.1 time: 0.153949 Aug 27 04:46:03.297774 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 692/1379] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:46:03 2021] GET /compute/v2.1/servers/9353ffc8-af99-478a-84a7-b3d3c94aa2b5 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:04.315872 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-da17275f-4329-42b6-bba2-e974e3f6e571 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:04.316577 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-da17275f-4329-42b6-bba2-e974e3f6e571 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: 9353ffc8-af99-478a-84a7-b3d3c94aa2b5] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:46:04.322547 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-da17275f-4329-42b6-bba2-e974e3f6e571 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:04.323121 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-da17275f-4329-42b6-bba2-e974e3f6e571 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:04.323906 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-da17275f-4329-42b6-bba2-e974e3f6e571 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:04.324375 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-da17275f-4329-42b6-bba2-e974e3f6e571 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:04.455500 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-da17275f-4329-42b6-bba2-e974e3f6e571 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:04.463619 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-da17275f-4329-42b6-bba2-e974e3f6e571 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/9353ffc8-af99-478a-84a7-b3d3c94aa2b5" status: 200 len: 1318 microversion: 2.1 time: 0.152813 Aug 27 04:46:04.464214 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 688/1380] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:46:04 2021] GET /compute/v2.1/servers/9353ffc8-af99-478a-84a7-b3d3c94aa2b5 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:05.387375 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [req-5227a916-5057-4997-87be-315786a8e8a8 req-84713afe-1048-488e-83c0-6ac26a6ed793 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9353ffc8-af99-478a-84a7-b3d3c94aa2b5", "name": "network-vif-plugged", "status": "completed", "tag": "feb51b59-4be7-4f3e-a070-ba91d8fbaadc"}]} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:46:05.389172 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:46:05.389172 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: warnings.warn(msg) Aug 27 04:46:05.396904 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-5227a916-5057-4997-87be-315786a8e8a8 req-84713afe-1048-488e-83c0-6ac26a6ed793 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:05.397425 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-5227a916-5057-4997-87be-315786a8e8a8 req-84713afe-1048-488e-83c0-6ac26a6ed793 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:05.409823 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.compute.server_external_events [req-5227a916-5057-4997-87be-315786a8e8a8 req-84713afe-1048-488e-83c0-6ac26a6ed793 service nova] Creating event network-vif-plugged:feb51b59-4be7-4f3e-a070-ba91d8fbaadc for instance 9353ffc8-af99-478a-84a7-b3d3c94aa2b5 on hv-cinder-80403 Aug 27 04:46:05.415446 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [req-5227a916-5057-4997-87be-315786a8e8a8 req-84713afe-1048-488e-83c0-6ac26a6ed793 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031981 Aug 27 04:46:05.416272 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 693/1381] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:46:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:46:05.480666 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-ddc16224-6c9e-414a-a509-1c2e2094a472 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:05.481308 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-ddc16224-6c9e-414a-a509-1c2e2094a472 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: 9353ffc8-af99-478a-84a7-b3d3c94aa2b5] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:46:05.487368 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ddc16224-6c9e-414a-a509-1c2e2094a472 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:05.487875 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ddc16224-6c9e-414a-a509-1c2e2094a472 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:05.488682 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ddc16224-6c9e-414a-a509-1c2e2094a472 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:05.489838 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ddc16224-6c9e-414a-a509-1c2e2094a472 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:05.619673 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-ddc16224-6c9e-414a-a509-1c2e2094a472 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:05.627097 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-ddc16224-6c9e-414a-a509-1c2e2094a472 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/9353ffc8-af99-478a-84a7-b3d3c94aa2b5" status: 200 len: 1318 microversion: 2.1 time: 0.150488 Aug 27 04:46:05.627675 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 689/1382] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:46:05 2021] GET /compute/v2.1/servers/9353ffc8-af99-478a-84a7-b3d3c94aa2b5 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:06.648416 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-745e7c5f-7781-413b-8746-511deebcf0f0 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:06.649488 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-745e7c5f-7781-413b-8746-511deebcf0f0 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: 9353ffc8-af99-478a-84a7-b3d3c94aa2b5] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:46:06.658950 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-745e7c5f-7781-413b-8746-511deebcf0f0 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:06.659696 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-745e7c5f-7781-413b-8746-511deebcf0f0 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:06.661670 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-745e7c5f-7781-413b-8746-511deebcf0f0 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:06.662413 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-745e7c5f-7781-413b-8746-511deebcf0f0 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:06.792460 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-745e7c5f-7781-413b-8746-511deebcf0f0 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:06.799746 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-745e7c5f-7781-413b-8746-511deebcf0f0 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/9353ffc8-af99-478a-84a7-b3d3c94aa2b5" status: 200 len: 1318 microversion: 2.1 time: 0.158491 Aug 27 04:46:06.800327 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 694/1383] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:46:06 2021] GET /compute/v2.1/servers/9353ffc8-af99-478a-84a7-b3d3c94aa2b5 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:07.220836 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-b0522374-1b10-4063-9773-6cd7c04d2a3d tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1533248071", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-725197301", "security_groups": [{"name": "tempest-secgroup-smoke-440466660"}], "block_device_mapping_v2": [{"uuid": "868dd495-03dd-4a05-82f0-5872fef891c9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1818e3b3-3df5-4098-8cd9-7e007e79848c"}]}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:46:07.327854 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.network.neutron [None req-b0522374-1b10-4063-9773-6cd7c04d2a3d tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] validate_networks() for [('1818e3b3-3df5-4098-8cd9-7e007e79848c', None, None, None, None, None)] {{(pid=108970) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 04:46:07.727319 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.virt.hardware [None req-b0522374-1b10-4063-9773-6cd7c04d2a3d tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Flavor limits 0:0:0 {{(pid=108970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:46:07.727741 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.virt.hardware [None req-b0522374-1b10-4063-9773-6cd7c04d2a3d tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Image limits 0:0:0 {{(pid=108970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:46:07.728269 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.virt.hardware [None req-b0522374-1b10-4063-9773-6cd7c04d2a3d tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Flavor pref 0:0:0 {{(pid=108970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:46:07.728969 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.virt.hardware [None req-b0522374-1b10-4063-9773-6cd7c04d2a3d tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Image pref 0:0:0 {{(pid=108970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:46:07.729709 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.virt.hardware [None req-b0522374-1b10-4063-9773-6cd7c04d2a3d tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:46:07.738618 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b0522374-1b10-4063-9773-6cd7c04d2a3d tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:07.739696 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b0522374-1b10-4063-9773-6cd7c04d2a3d tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:07.740588 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b0522374-1b10-4063-9773-6cd7c04d2a3d tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:07.741027 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b0522374-1b10-4063-9773-6cd7c04d2a3d tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:07.758652 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.quota [None req-b0522374-1b10-4063-9773-6cd7c04d2a3d tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Getting quotas for project 268453b6c33d4cc0a6486da778b00f9b. Resources: {'ram', 'cores', 'instances'} {{(pid=108970) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:46:07.764244 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.quota [None req-b0522374-1b10-4063-9773-6cd7c04d2a3d tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Getting quotas for user c5af28c28d4044fe8b57978dd4b775e3 and project 268453b6c33d4cc0a6486da778b00f9b. Resources: {'ram', 'cores', 'instances'} {{(pid=108970) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:46:07.815547 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-0684f237-8353-4e19-8749-8b45188ba0b1 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:07.816240 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-0684f237-8353-4e19-8749-8b45188ba0b1 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: 9353ffc8-af99-478a-84a7-b3d3c94aa2b5] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:46:07.822482 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0684f237-8353-4e19-8749-8b45188ba0b1 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:07.823259 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0684f237-8353-4e19-8749-8b45188ba0b1 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:07.823617 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0684f237-8353-4e19-8749-8b45188ba0b1 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:07.824082 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-0684f237-8353-4e19-8749-8b45188ba0b1 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:07.829357 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-b0522374-1b10-4063-9773-6cd7c04d2a3d tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Going to run 1 instances... {{(pid=108970) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 04:46:07.831482 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-b0522374-1b10-4063-9773-6cd7c04d2a3d tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 0e1ad5f4-a543-4d5f-bfcc-521717d219f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='868dd495-03dd-4a05-82f0-5872fef891c9',volume_size=None,volume_type=None)] {{(pid=108970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 04:46:07.956011 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-0684f237-8353-4e19-8749-8b45188ba0b1 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:07.964518 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-0684f237-8353-4e19-8749-8b45188ba0b1 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/9353ffc8-af99-478a-84a7-b3d3c94aa2b5" status: 200 len: 1508 microversion: 2.1 time: 0.152520 Aug 27 04:46:07.965108 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 695/1384] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:46:07 2021] GET /compute/v2.1/servers/9353ffc8-af99-478a-84a7-b3d3c94aa2b5 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:46:07.975023 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-b0522374-1b10-4063-9773-6cd7c04d2a3d tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.758029 Aug 27 04:46:07.976085 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 690/1385] 10.222.0.53 () {60 vars in 1147 bytes} [Fri Aug 27 04:46:07 2021] POST /compute/v2.1/servers => generated 405 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:46:07.986710 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-9751d7a3-e5e7-4d52-af59-342a88d33adf tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:07.987338 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-9751d7a3-e5e7-4d52-af59-342a88d33adf tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 0e1ad5f4-a543-4d5f-bfcc-521717d219f7] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:46:08.056607 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-9751d7a3-e5e7-4d52-af59-342a88d33adf tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5af28c28d4044fe8b57978dd4b775e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268453b6c33d4cc0a6486da778b00f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:08.068210 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-9751d7a3-e5e7-4d52-af59-342a88d33adf tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/0e1ad5f4-a543-4d5f-bfcc-521717d219f7" status: 200 len: 1094 microversion: 2.1 time: 0.085140 Aug 27 04:46:08.069268 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 696/1386] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:46:07 2021] GET /compute/v2.1/servers/0e1ad5f4-a543-4d5f-bfcc-521717d219f7 => generated 1094 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:09.085256 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-01e5a445-7583-4b43-993b-e0de6c12c46d tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:09.089271 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-01e5a445-7583-4b43-993b-e0de6c12c46d tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 0e1ad5f4-a543-4d5f-bfcc-521717d219f7] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:46:09.092836 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-01e5a445-7583-4b43-993b-e0de6c12c46d tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:09.093293 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-01e5a445-7583-4b43-993b-e0de6c12c46d tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:09.094116 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-01e5a445-7583-4b43-993b-e0de6c12c46d tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:09.094560 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-01e5a445-7583-4b43-993b-e0de6c12c46d tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:09.171603 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-01e5a445-7583-4b43-993b-e0de6c12c46d tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5af28c28d4044fe8b57978dd4b775e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268453b6c33d4cc0a6486da778b00f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:09.181413 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-01e5a445-7583-4b43-993b-e0de6c12c46d tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/0e1ad5f4-a543-4d5f-bfcc-521717d219f7" status: 200 len: 1200 microversion: 2.1 time: 0.100052 Aug 27 04:46:09.182146 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 691/1387] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:46:09 2021] GET /compute/v2.1/servers/0e1ad5f4-a543-4d5f-bfcc-521717d219f7 => generated 1200 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:09.375170 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-5ed7c304-1778-4146-8450-c798808af1d6 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "712d2f5d-d7a2-4f0b-88aa-ce56e427b7c2"}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:46:09.376322 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-5ed7c304-1778-4146-8450-c798808af1d6 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: 9353ffc8-af99-478a-84a7-b3d3c94aa2b5] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:46:09.382741 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5ed7c304-1778-4146-8450-c798808af1d6 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:09.383194 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5ed7c304-1778-4146-8450-c798808af1d6 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:09.384073 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5ed7c304-1778-4146-8450-c798808af1d6 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:09.384595 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5ed7c304-1778-4146-8450-c798808af1d6 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:09.704595 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-5ed7c304-1778-4146-8450-c798808af1d6 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "POST /compute/v2.1/servers/9353ffc8-af99-478a-84a7-b3d3c94aa2b5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.333030 Aug 27 04:46:09.705250 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 697/1388] 10.222.0.53 () {60 vars in 1323 bytes} [Fri Aug 27 04:46:09 2021] POST /compute/v2.1/servers/9353ffc8-af99-478a-84a7-b3d3c94aa2b5/os-volume_attachments => generated 194 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:46:10.199561 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-e3190d71-f790-41f4-8466-30f8a100aa20 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:10.200224 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-e3190d71-f790-41f4-8466-30f8a100aa20 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 0e1ad5f4-a543-4d5f-bfcc-521717d219f7] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:46:10.206282 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e3190d71-f790-41f4-8466-30f8a100aa20 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:10.206731 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e3190d71-f790-41f4-8466-30f8a100aa20 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:10.207512 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e3190d71-f790-41f4-8466-30f8a100aa20 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:10.208585 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e3190d71-f790-41f4-8466-30f8a100aa20 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:10.338602 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-e3190d71-f790-41f4-8466-30f8a100aa20 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5af28c28d4044fe8b57978dd4b775e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268453b6c33d4cc0a6486da778b00f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:10.346248 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-e3190d71-f790-41f4-8466-30f8a100aa20 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/0e1ad5f4-a543-4d5f-bfcc-521717d219f7" status: 200 len: 1265 microversion: 2.1 time: 0.150904 Aug 27 04:46:10.347056 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 692/1389] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:46:10 2021] GET /compute/v2.1/servers/0e1ad5f4-a543-4d5f-bfcc-521717d219f7 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:10.658035 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [req-3f4e8683-5cba-40e6-801c-bd1be42f8ba6 req-dca17ff5-bf2a-43ad-9658-5c5ccaf5f848 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e1ad5f4-a543-4d5f-bfcc-521717d219f7", "tag": "2f4fdbaf-69a6-4d05-be39-30fa63e09ed7"}]} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:46:10.660072 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:46:10.660072 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: warnings.warn(msg) Aug 27 04:46:10.671821 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-3f4e8683-5cba-40e6-801c-bd1be42f8ba6 req-dca17ff5-bf2a-43ad-9658-5c5ccaf5f848 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:10.672371 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-3f4e8683-5cba-40e6-801c-bd1be42f8ba6 req-dca17ff5-bf2a-43ad-9658-5c5ccaf5f848 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:10.686783 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.compute.server_external_events [req-3f4e8683-5cba-40e6-801c-bd1be42f8ba6 req-dca17ff5-bf2a-43ad-9658-5c5ccaf5f848 service nova] Creating event network-changed:2f4fdbaf-69a6-4d05-be39-30fa63e09ed7 for instance 0e1ad5f4-a543-4d5f-bfcc-521717d219f7 on hv-cinder-80403 Aug 27 04:46:10.692819 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [req-3f4e8683-5cba-40e6-801c-bd1be42f8ba6 req-dca17ff5-bf2a-43ad-9658-5c5ccaf5f848 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038608 Aug 27 04:46:10.693732 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 698/1390] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:46:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:46:11.363805 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-d11093d9-2e1c-43a7-a49e-e53d1e0901d5 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:11.364446 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-d11093d9-2e1c-43a7-a49e-e53d1e0901d5 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 0e1ad5f4-a543-4d5f-bfcc-521717d219f7] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:46:11.380182 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d11093d9-2e1c-43a7-a49e-e53d1e0901d5 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:11.381354 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d11093d9-2e1c-43a7-a49e-e53d1e0901d5 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:11.382270 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d11093d9-2e1c-43a7-a49e-e53d1e0901d5 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:11.382815 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d11093d9-2e1c-43a7-a49e-e53d1e0901d5 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:11.513673 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-d11093d9-2e1c-43a7-a49e-e53d1e0901d5 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5af28c28d4044fe8b57978dd4b775e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268453b6c33d4cc0a6486da778b00f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:11.521755 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-d11093d9-2e1c-43a7-a49e-e53d1e0901d5 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/0e1ad5f4-a543-4d5f-bfcc-521717d219f7" status: 200 len: 1265 microversion: 2.1 time: 0.160992 Aug 27 04:46:11.522410 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 693/1391] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:46:11 2021] GET /compute/v2.1/servers/0e1ad5f4-a543-4d5f-bfcc-521717d219f7 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:12.540529 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-7b7626bd-af77-4017-9e53-c90400fb11f7 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:12.541690 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-7b7626bd-af77-4017-9e53-c90400fb11f7 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 0e1ad5f4-a543-4d5f-bfcc-521717d219f7] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:46:12.550834 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7b7626bd-af77-4017-9e53-c90400fb11f7 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:12.551230 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7b7626bd-af77-4017-9e53-c90400fb11f7 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:12.552020 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7b7626bd-af77-4017-9e53-c90400fb11f7 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:12.552941 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7b7626bd-af77-4017-9e53-c90400fb11f7 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:12.694163 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-7b7626bd-af77-4017-9e53-c90400fb11f7 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5af28c28d4044fe8b57978dd4b775e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268453b6c33d4cc0a6486da778b00f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:12.702570 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-7b7626bd-af77-4017-9e53-c90400fb11f7 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/0e1ad5f4-a543-4d5f-bfcc-521717d219f7" status: 200 len: 1265 microversion: 2.1 time: 0.167149 Aug 27 04:46:12.703195 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 699/1392] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:46:12 2021] GET /compute/v2.1/servers/0e1ad5f4-a543-4d5f-bfcc-521717d219f7 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:13.718608 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-76f87292-f598-48cb-a593-8085661f7193 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:13.719231 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-76f87292-f598-48cb-a593-8085661f7193 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 0e1ad5f4-a543-4d5f-bfcc-521717d219f7] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:46:13.725879 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-76f87292-f598-48cb-a593-8085661f7193 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:13.726371 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-76f87292-f598-48cb-a593-8085661f7193 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:13.727187 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-76f87292-f598-48cb-a593-8085661f7193 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:13.727631 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-76f87292-f598-48cb-a593-8085661f7193 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:13.860838 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-76f87292-f598-48cb-a593-8085661f7193 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5af28c28d4044fe8b57978dd4b775e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268453b6c33d4cc0a6486da778b00f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:13.869178 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-76f87292-f598-48cb-a593-8085661f7193 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/0e1ad5f4-a543-4d5f-bfcc-521717d219f7" status: 200 len: 1265 microversion: 2.1 time: 0.154248 Aug 27 04:46:13.869763 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 694/1393] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:46:13 2021] GET /compute/v2.1/servers/0e1ad5f4-a543-4d5f-bfcc-521717d219f7 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:14.885477 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-1700c167-f404-4004-9ba5-3f6b66fa35c9 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:14.886083 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-1700c167-f404-4004-9ba5-3f6b66fa35c9 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 0e1ad5f4-a543-4d5f-bfcc-521717d219f7] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:46:14.892202 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1700c167-f404-4004-9ba5-3f6b66fa35c9 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:14.892699 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1700c167-f404-4004-9ba5-3f6b66fa35c9 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:14.893473 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1700c167-f404-4004-9ba5-3f6b66fa35c9 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:14.893908 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1700c167-f404-4004-9ba5-3f6b66fa35c9 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:15.020814 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-1700c167-f404-4004-9ba5-3f6b66fa35c9 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5af28c28d4044fe8b57978dd4b775e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268453b6c33d4cc0a6486da778b00f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:15.029266 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-1700c167-f404-4004-9ba5-3f6b66fa35c9 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/0e1ad5f4-a543-4d5f-bfcc-521717d219f7" status: 200 len: 1265 microversion: 2.1 time: 0.147577 Aug 27 04:46:15.030198 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 700/1394] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:46:14 2021] GET /compute/v2.1/servers/0e1ad5f4-a543-4d5f-bfcc-521717d219f7 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:16.046416 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-f4cc5f5f-26ab-47d1-8e29-3be80cabdf8d tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:16.047068 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-f4cc5f5f-26ab-47d1-8e29-3be80cabdf8d tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 0e1ad5f4-a543-4d5f-bfcc-521717d219f7] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:46:16.053136 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f4cc5f5f-26ab-47d1-8e29-3be80cabdf8d tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:16.053623 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f4cc5f5f-26ab-47d1-8e29-3be80cabdf8d tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:16.054407 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f4cc5f5f-26ab-47d1-8e29-3be80cabdf8d tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:16.054850 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f4cc5f5f-26ab-47d1-8e29-3be80cabdf8d tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:16.199915 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-f4cc5f5f-26ab-47d1-8e29-3be80cabdf8d tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5af28c28d4044fe8b57978dd4b775e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268453b6c33d4cc0a6486da778b00f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:16.207360 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-f4cc5f5f-26ab-47d1-8e29-3be80cabdf8d tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/0e1ad5f4-a543-4d5f-bfcc-521717d219f7" status: 200 len: 1265 microversion: 2.1 time: 0.164623 Aug 27 04:46:16.207930 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 695/1395] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:46:16 2021] GET /compute/v2.1/servers/0e1ad5f4-a543-4d5f-bfcc-521717d219f7 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:17.225713 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-75ce8165-e826-4923-a97c-87fb7a35640e tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:17.226319 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-75ce8165-e826-4923-a97c-87fb7a35640e tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 0e1ad5f4-a543-4d5f-bfcc-521717d219f7] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:46:17.237107 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-75ce8165-e826-4923-a97c-87fb7a35640e tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:17.237107 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-75ce8165-e826-4923-a97c-87fb7a35640e tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:17.237107 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-75ce8165-e826-4923-a97c-87fb7a35640e tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:17.237107 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-75ce8165-e826-4923-a97c-87fb7a35640e tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:17.357143 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-fa01f624-28bf-4489-9c3c-b75fc983f057 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:17.357736 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-fa01f624-28bf-4489-9c3c-b75fc983f057 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: 9353ffc8-af99-478a-84a7-b3d3c94aa2b5] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:46:17.363953 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fa01f624-28bf-4489-9c3c-b75fc983f057 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:17.364453 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fa01f624-28bf-4489-9c3c-b75fc983f057 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:17.365307 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fa01f624-28bf-4489-9c3c-b75fc983f057 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:17.365768 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fa01f624-28bf-4489-9c3c-b75fc983f057 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:17.376642 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-75ce8165-e826-4923-a97c-87fb7a35640e tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5af28c28d4044fe8b57978dd4b775e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268453b6c33d4cc0a6486da778b00f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:17.385369 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-75ce8165-e826-4923-a97c-87fb7a35640e tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/0e1ad5f4-a543-4d5f-bfcc-521717d219f7" status: 200 len: 1265 microversion: 2.1 time: 0.163294 Aug 27 04:46:17.385870 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 701/1396] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:46:17 2021] GET /compute/v2.1/servers/0e1ad5f4-a543-4d5f-bfcc-521717d219f7 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:17.458070 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.objects.instance [None req-fa01f624-28bf-4489-9c3c-b75fc983f057 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lazy-loading 'services' on Instance uuid 9353ffc8-af99-478a-84a7-b3d3c94aa2b5 {{(pid=108970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:46:17.524186 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-fa01f624-28bf-4489-9c3c-b75fc983f057 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "DELETE /compute/v2.1/servers/9353ffc8-af99-478a-84a7-b3d3c94aa2b5/os-volume_attachments/712d2f5d-d7a2-4f0b-88aa-ce56e427b7c2" status: 202 len: 0 microversion: 2.1 time: 0.170933 Aug 27 04:46:17.524799 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 696/1397] 10.222.0.53 () {58 vars in 1416 bytes} [Fri Aug 27 04:46:17 2021] DELETE /compute/v2.1/servers/9353ffc8-af99-478a-84a7-b3d3c94aa2b5/os-volume_attachments/712d2f5d-d7a2-4f0b-88aa-ce56e427b7c2 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:46:17.533087 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-08346520-42c6-41b2-b0f2-98068f2a499d tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:17.534045 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-08346520-42c6-41b2-b0f2-98068f2a499d tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: 9353ffc8-af99-478a-84a7-b3d3c94aa2b5] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:46:17.540012 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-08346520-42c6-41b2-b0f2-98068f2a499d tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:17.540485 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-08346520-42c6-41b2-b0f2-98068f2a499d tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:17.541264 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-08346520-42c6-41b2-b0f2-98068f2a499d tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:17.541712 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-08346520-42c6-41b2-b0f2-98068f2a499d tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:17.577096 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-08346520-42c6-41b2-b0f2-98068f2a499d tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/9353ffc8-af99-478a-84a7-b3d3c94aa2b5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047723 Aug 27 04:46:17.577659 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 702/1398] 10.222.0.53 () {58 vars in 1302 bytes} [Fri Aug 27 04:46:17 2021] GET /compute/v2.1/servers/9353ffc8-af99-478a-84a7-b3d3c94aa2b5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:46:18.403169 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-f19c896e-7a66-457b-a0a7-67f989d64fa8 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:18.403777 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-f19c896e-7a66-457b-a0a7-67f989d64fa8 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 0e1ad5f4-a543-4d5f-bfcc-521717d219f7] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:46:18.410342 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f19c896e-7a66-457b-a0a7-67f989d64fa8 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:18.410784 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f19c896e-7a66-457b-a0a7-67f989d64fa8 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:18.412078 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f19c896e-7a66-457b-a0a7-67f989d64fa8 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:18.412514 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f19c896e-7a66-457b-a0a7-67f989d64fa8 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:18.540859 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-f19c896e-7a66-457b-a0a7-67f989d64fa8 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5af28c28d4044fe8b57978dd4b775e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268453b6c33d4cc0a6486da778b00f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:18.548574 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-f19c896e-7a66-457b-a0a7-67f989d64fa8 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/0e1ad5f4-a543-4d5f-bfcc-521717d219f7" status: 200 len: 1265 microversion: 2.1 time: 0.149520 Aug 27 04:46:18.549155 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 697/1399] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:46:18 2021] GET /compute/v2.1/servers/0e1ad5f4-a543-4d5f-bfcc-521717d219f7 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:18.589438 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-815df393-0ec6-43dc-83c6-6e3f13dc41bb tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:18.590440 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-815df393-0ec6-43dc-83c6-6e3f13dc41bb tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: 9353ffc8-af99-478a-84a7-b3d3c94aa2b5] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:46:18.596490 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-815df393-0ec6-43dc-83c6-6e3f13dc41bb tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:18.596939 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-815df393-0ec6-43dc-83c6-6e3f13dc41bb tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:18.597724 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-815df393-0ec6-43dc-83c6-6e3f13dc41bb tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:18.598154 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-815df393-0ec6-43dc-83c6-6e3f13dc41bb tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:18.629539 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-815df393-0ec6-43dc-83c6-6e3f13dc41bb tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/9353ffc8-af99-478a-84a7-b3d3c94aa2b5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044004 Aug 27 04:46:18.630090 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 703/1400] 10.222.0.53 () {58 vars in 1302 bytes} [Fri Aug 27 04:46:18 2021] GET /compute/v2.1/servers/9353ffc8-af99-478a-84a7-b3d3c94aa2b5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:46:19.566771 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-bd338f85-15a8-4d98-bc4d-d84a9cabcd76 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:19.567411 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-bd338f85-15a8-4d98-bc4d-d84a9cabcd76 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 0e1ad5f4-a543-4d5f-bfcc-521717d219f7] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:46:19.573750 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-bd338f85-15a8-4d98-bc4d-d84a9cabcd76 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:19.574194 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-bd338f85-15a8-4d98-bc4d-d84a9cabcd76 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:19.574980 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-bd338f85-15a8-4d98-bc4d-d84a9cabcd76 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:19.575412 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-bd338f85-15a8-4d98-bc4d-d84a9cabcd76 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:19.640885 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-44ee0542-1800-432a-8e3c-36eaddfce75a tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:19.641925 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-44ee0542-1800-432a-8e3c-36eaddfce75a tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: 9353ffc8-af99-478a-84a7-b3d3c94aa2b5] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:46:19.649031 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-44ee0542-1800-432a-8e3c-36eaddfce75a tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:19.649575 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-44ee0542-1800-432a-8e3c-36eaddfce75a tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:19.650465 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-44ee0542-1800-432a-8e3c-36eaddfce75a tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:19.650973 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-44ee0542-1800-432a-8e3c-36eaddfce75a tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:19.693924 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-44ee0542-1800-432a-8e3c-36eaddfce75a tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/9353ffc8-af99-478a-84a7-b3d3c94aa2b5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056728 Aug 27 04:46:19.694837 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 704/1401] 10.222.0.53 () {58 vars in 1302 bytes} [Fri Aug 27 04:46:19 2021] GET /compute/v2.1/servers/9353ffc8-af99-478a-84a7-b3d3c94aa2b5/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 04:46:19.708939 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-bd338f85-15a8-4d98-bc4d-d84a9cabcd76 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5af28c28d4044fe8b57978dd4b775e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268453b6c33d4cc0a6486da778b00f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:19.716390 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-bd338f85-15a8-4d98-bc4d-d84a9cabcd76 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/0e1ad5f4-a543-4d5f-bfcc-521717d219f7" status: 200 len: 1265 microversion: 2.1 time: 0.153393 Aug 27 04:46:19.717061 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 698/1402] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:46:19 2021] GET /compute/v2.1/servers/0e1ad5f4-a543-4d5f-bfcc-521717d219f7 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:20.734090 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-1d8fdf6a-7289-48ef-8888-9f954af2c03a tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:20.734639 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-1d8fdf6a-7289-48ef-8888-9f954af2c03a tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 0e1ad5f4-a543-4d5f-bfcc-521717d219f7] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:46:20.741127 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1d8fdf6a-7289-48ef-8888-9f954af2c03a tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:20.741577 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1d8fdf6a-7289-48ef-8888-9f954af2c03a tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:20.742377 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1d8fdf6a-7289-48ef-8888-9f954af2c03a tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:20.742826 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1d8fdf6a-7289-48ef-8888-9f954af2c03a tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:20.870145 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-1d8fdf6a-7289-48ef-8888-9f954af2c03a tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5af28c28d4044fe8b57978dd4b775e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268453b6c33d4cc0a6486da778b00f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:20.877700 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-1d8fdf6a-7289-48ef-8888-9f954af2c03a tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/0e1ad5f4-a543-4d5f-bfcc-521717d219f7" status: 200 len: 1265 microversion: 2.1 time: 0.147340 Aug 27 04:46:20.878859 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 705/1403] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:46:20 2021] GET /compute/v2.1/servers/0e1ad5f4-a543-4d5f-bfcc-521717d219f7 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:20.899360 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-2228a665-2760-485d-b03d-cd6a135acadc tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:20.899907 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-2228a665-2760-485d-b03d-cd6a135acadc tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: 9353ffc8-af99-478a-84a7-b3d3c94aa2b5] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:46:20.906146 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2228a665-2760-485d-b03d-cd6a135acadc tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:20.906601 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2228a665-2760-485d-b03d-cd6a135acadc tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:20.907384 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2228a665-2760-485d-b03d-cd6a135acadc tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:20.907873 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2228a665-2760-485d-b03d-cd6a135acadc tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:20.934837 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-2228a665-2760-485d-b03d-cd6a135acadc tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: 9353ffc8-af99-478a-84a7-b3d3c94aa2b5] Going to try to terminate instance {{(pid=108970) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 04:46:21.022985 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-2228a665-2760-485d-b03d-cd6a135acadc tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "DELETE /compute/v2.1/servers/9353ffc8-af99-478a-84a7-b3d3c94aa2b5" status: 204 len: 0 microversion: 2.1 time: 0.126701 Aug 27 04:46:21.023653 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 699/1404] 10.222.0.53 () {58 vars in 1239 bytes} [Fri Aug 27 04:46:20 2021] DELETE /compute/v2.1/servers/9353ffc8-af99-478a-84a7-b3d3c94aa2b5 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:46:21.035724 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-38a9c416-8bfc-40aa-9156-2c2e22cadf08 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:21.036377 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-38a9c416-8bfc-40aa-9156-2c2e22cadf08 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: 9353ffc8-af99-478a-84a7-b3d3c94aa2b5] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:46:21.042412 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-38a9c416-8bfc-40aa-9156-2c2e22cadf08 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:21.042860 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-38a9c416-8bfc-40aa-9156-2c2e22cadf08 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:21.043633 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-38a9c416-8bfc-40aa-9156-2c2e22cadf08 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:21.044101 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-38a9c416-8bfc-40aa-9156-2c2e22cadf08 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:21.193262 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-38a9c416-8bfc-40aa-9156-2c2e22cadf08 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:21.200833 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-38a9c416-8bfc-40aa-9156-2c2e22cadf08 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/9353ffc8-af99-478a-84a7-b3d3c94aa2b5" status: 200 len: 1514 microversion: 2.1 time: 0.168699 Aug 27 04:46:21.201410 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 706/1405] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:46:21 2021] GET /compute/v2.1/servers/9353ffc8-af99-478a-84a7-b3d3c94aa2b5 => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:21.895583 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-715d6a94-08ec-456b-8b67-856300a837a5 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:21.896913 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-715d6a94-08ec-456b-8b67-856300a837a5 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 0e1ad5f4-a543-4d5f-bfcc-521717d219f7] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:46:21.902821 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-715d6a94-08ec-456b-8b67-856300a837a5 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:21.903428 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-715d6a94-08ec-456b-8b67-856300a837a5 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:21.904031 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-715d6a94-08ec-456b-8b67-856300a837a5 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:21.904473 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-715d6a94-08ec-456b-8b67-856300a837a5 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:22.025677 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-715d6a94-08ec-456b-8b67-856300a837a5 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5af28c28d4044fe8b57978dd4b775e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268453b6c33d4cc0a6486da778b00f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:22.033084 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-715d6a94-08ec-456b-8b67-856300a837a5 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/0e1ad5f4-a543-4d5f-bfcc-521717d219f7" status: 200 len: 1265 microversion: 2.1 time: 0.141476 Aug 27 04:46:22.033659 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 700/1406] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:46:21 2021] GET /compute/v2.1/servers/0e1ad5f4-a543-4d5f-bfcc-521717d219f7 => generated 1265 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:22.217736 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-18cff386-a132-4ea7-963a-83050038fecd tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:22.218357 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-18cff386-a132-4ea7-963a-83050038fecd tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: 9353ffc8-af99-478a-84a7-b3d3c94aa2b5] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:46:22.224558 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-18cff386-a132-4ea7-963a-83050038fecd tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:22.225006 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-18cff386-a132-4ea7-963a-83050038fecd tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:22.225818 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-18cff386-a132-4ea7-963a-83050038fecd tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:22.226258 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-18cff386-a132-4ea7-963a-83050038fecd tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:22.362552 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-18cff386-a132-4ea7-963a-83050038fecd tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:22.370411 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-18cff386-a132-4ea7-963a-83050038fecd tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/9353ffc8-af99-478a-84a7-b3d3c94aa2b5" status: 200 len: 1514 microversion: 2.1 time: 0.156426 Aug 27 04:46:22.371026 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 707/1407] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:46:22 2021] GET /compute/v2.1/servers/9353ffc8-af99-478a-84a7-b3d3c94aa2b5 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:23.049568 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-6830a069-d9c0-435b-8330-eea62ac897b1 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:23.050187 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-6830a069-d9c0-435b-8330-eea62ac897b1 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 0e1ad5f4-a543-4d5f-bfcc-521717d219f7] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:46:23.056883 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6830a069-d9c0-435b-8330-eea62ac897b1 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:23.057340 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6830a069-d9c0-435b-8330-eea62ac897b1 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:23.058128 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6830a069-d9c0-435b-8330-eea62ac897b1 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:23.058571 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6830a069-d9c0-435b-8330-eea62ac897b1 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:23.196679 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-6830a069-d9c0-435b-8330-eea62ac897b1 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5af28c28d4044fe8b57978dd4b775e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268453b6c33d4cc0a6486da778b00f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:23.204140 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-6830a069-d9c0-435b-8330-eea62ac897b1 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/0e1ad5f4-a543-4d5f-bfcc-521717d219f7" status: 200 len: 1265 microversion: 2.1 time: 0.158428 Aug 27 04:46:23.204717 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 701/1408] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:46:23 2021] GET /compute/v2.1/servers/0e1ad5f4-a543-4d5f-bfcc-521717d219f7 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:23.387218 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-4213d0e1-38c5-4441-b1ff-82ef3a26fc76 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:23.387832 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-4213d0e1-38c5-4441-b1ff-82ef3a26fc76 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: 9353ffc8-af99-478a-84a7-b3d3c94aa2b5] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:46:23.394383 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-4213d0e1-38c5-4441-b1ff-82ef3a26fc76 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:23.394973 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-4213d0e1-38c5-4441-b1ff-82ef3a26fc76 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:23.396393 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-4213d0e1-38c5-4441-b1ff-82ef3a26fc76 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:23.396895 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-4213d0e1-38c5-4441-b1ff-82ef3a26fc76 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:23.540836 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [req-2509ee50-6e56-4fb9-9666-527a02215b58 req-856838e7-cb61-4347-b252-da379258ce1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e1ad5f4-a543-4d5f-bfcc-521717d219f7", "name": "network-vif-plugged", "status": "completed", "tag": "2f4fdbaf-69a6-4d05-be39-30fa63e09ed7"}]} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:46:23.542584 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:46:23.542584 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: warnings.warn(msg) Aug 27 04:46:23.549575 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-2509ee50-6e56-4fb9-9666-527a02215b58 req-856838e7-cb61-4347-b252-da379258ce1f service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:23.550015 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-2509ee50-6e56-4fb9-9666-527a02215b58 req-856838e7-cb61-4347-b252-da379258ce1f service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:23.562351 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.compute.server_external_events [req-2509ee50-6e56-4fb9-9666-527a02215b58 req-856838e7-cb61-4347-b252-da379258ce1f service nova] Creating event network-vif-plugged:2f4fdbaf-69a6-4d05-be39-30fa63e09ed7 for instance 0e1ad5f4-a543-4d5f-bfcc-521717d219f7 on hv-cinder-80403 Aug 27 04:46:23.568390 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [req-2509ee50-6e56-4fb9-9666-527a02215b58 req-856838e7-cb61-4347-b252-da379258ce1f service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030558 Aug 27 04:46:23.569547 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 702/1409] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:46:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:46:23.625081 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-4213d0e1-38c5-4441-b1ff-82ef3a26fc76 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:23.634832 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-4213d0e1-38c5-4441-b1ff-82ef3a26fc76 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/9353ffc8-af99-478a-84a7-b3d3c94aa2b5" status: 200 len: 1514 microversion: 2.1 time: 0.251207 Aug 27 04:46:23.636581 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 708/1410] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:46:23 2021] GET /compute/v2.1/servers/9353ffc8-af99-478a-84a7-b3d3c94aa2b5 => generated 1514 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:24.025581 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [req-36feb94a-33bd-4739-a81d-ee654161480f req-5eef8959-627a-42b7-9869-710a89545d79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9353ffc8-af99-478a-84a7-b3d3c94aa2b5", "name": "network-vif-deleted", "tag": "feb51b59-4be7-4f3e-a070-ba91d8fbaadc"}]} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:46:24.027042 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:46:24.027042 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: warnings.warn(msg) Aug 27 04:46:24.037442 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-36feb94a-33bd-4739-a81d-ee654161480f req-5eef8959-627a-42b7-9869-710a89545d79 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:24.038065 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-36feb94a-33bd-4739-a81d-ee654161480f req-5eef8959-627a-42b7-9869-710a89545d79 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:24.056236 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.compute.server_external_events [req-36feb94a-33bd-4739-a81d-ee654161480f req-5eef8959-627a-42b7-9869-710a89545d79 service nova] Creating event network-vif-deleted:feb51b59-4be7-4f3e-a070-ba91d8fbaadc for instance 9353ffc8-af99-478a-84a7-b3d3c94aa2b5 on hv-cinder-80403 Aug 27 04:46:24.064494 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [req-36feb94a-33bd-4739-a81d-ee654161480f req-5eef8959-627a-42b7-9869-710a89545d79 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042309 Aug 27 04:46:24.065583 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 703/1411] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:46:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:46:24.221615 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-28f09738-442d-47f2-a58d-5f03a56caf07 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:24.222225 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-28f09738-442d-47f2-a58d-5f03a56caf07 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 0e1ad5f4-a543-4d5f-bfcc-521717d219f7] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:46:24.229078 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-28f09738-442d-47f2-a58d-5f03a56caf07 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:24.229621 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-28f09738-442d-47f2-a58d-5f03a56caf07 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:24.230705 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-28f09738-442d-47f2-a58d-5f03a56caf07 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:24.231411 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-28f09738-442d-47f2-a58d-5f03a56caf07 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:24.381613 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-28f09738-442d-47f2-a58d-5f03a56caf07 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5af28c28d4044fe8b57978dd4b775e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268453b6c33d4cc0a6486da778b00f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:24.389911 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-28f09738-442d-47f2-a58d-5f03a56caf07 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/0e1ad5f4-a543-4d5f-bfcc-521717d219f7" status: 200 len: 1265 microversion: 2.1 time: 0.172210 Aug 27 04:46:24.390731 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 709/1412] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:46:24 2021] GET /compute/v2.1/servers/0e1ad5f4-a543-4d5f-bfcc-521717d219f7 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:24.655665 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-3aae0d54-82ff-4e4d-9145-35e43e47de51 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:24.656928 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-3aae0d54-82ff-4e4d-9145-35e43e47de51 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: 9353ffc8-af99-478a-84a7-b3d3c94aa2b5] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:46:24.664342 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3aae0d54-82ff-4e4d-9145-35e43e47de51 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:24.664795 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3aae0d54-82ff-4e4d-9145-35e43e47de51 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:24.665578 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3aae0d54-82ff-4e4d-9145-35e43e47de51 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:24.666018 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3aae0d54-82ff-4e4d-9145-35e43e47de51 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:24.707395 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3aae0d54-82ff-4e4d-9145-35e43e47de51 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:24.708214 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3aae0d54-82ff-4e4d-9145-35e43e47de51 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:24.708974 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.objects.instance [None req-3aae0d54-82ff-4e4d-9145-35e43e47de51 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lazy-loading 'fault' on Instance uuid 9353ffc8-af99-478a-84a7-b3d3c94aa2b5 {{(pid=108970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:46:24.759278 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-3aae0d54-82ff-4e4d-9145-35e43e47de51 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:24.767156 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-3aae0d54-82ff-4e4d-9145-35e43e47de51 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/9353ffc8-af99-478a-84a7-b3d3c94aa2b5" status: 200 len: 1308 microversion: 2.1 time: 0.118453 Aug 27 04:46:24.770326 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 704/1413] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:46:24 2021] GET /compute/v2.1/servers/9353ffc8-af99-478a-84a7-b3d3c94aa2b5 => generated 1308 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:25.407305 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-895ed0a1-f9b5-4e8f-8fb5-97c4842d4197 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:25.407918 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-895ed0a1-f9b5-4e8f-8fb5-97c4842d4197 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 0e1ad5f4-a543-4d5f-bfcc-521717d219f7] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:46:25.414994 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-895ed0a1-f9b5-4e8f-8fb5-97c4842d4197 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:25.415449 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-895ed0a1-f9b5-4e8f-8fb5-97c4842d4197 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:25.416390 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-895ed0a1-f9b5-4e8f-8fb5-97c4842d4197 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:25.416830 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-895ed0a1-f9b5-4e8f-8fb5-97c4842d4197 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:25.544136 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-895ed0a1-f9b5-4e8f-8fb5-97c4842d4197 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5af28c28d4044fe8b57978dd4b775e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268453b6c33d4cc0a6486da778b00f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:25.551501 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-895ed0a1-f9b5-4e8f-8fb5-97c4842d4197 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/0e1ad5f4-a543-4d5f-bfcc-521717d219f7" status: 200 len: 1265 microversion: 2.1 time: 0.147900 Aug 27 04:46:25.552108 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 710/1414] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:46:25 2021] GET /compute/v2.1/servers/0e1ad5f4-a543-4d5f-bfcc-521717d219f7 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:25.787258 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-748aba83-0be4-4e63-a69e-e8dcae9d2299 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:25.787889 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-748aba83-0be4-4e63-a69e-e8dcae9d2299 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: 9353ffc8-af99-478a-84a7-b3d3c94aa2b5] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:46:25.794221 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-748aba83-0be4-4e63-a69e-e8dcae9d2299 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:25.794664 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-748aba83-0be4-4e63-a69e-e8dcae9d2299 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:25.795427 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-748aba83-0be4-4e63-a69e-e8dcae9d2299 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:25.795859 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-748aba83-0be4-4e63-a69e-e8dcae9d2299 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:25.810535 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.wsgi [None req-748aba83-0be4-4e63-a69e-e8dcae9d2299 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] HTTP exception thrown: Instance 9353ffc8-af99-478a-84a7-b3d3c94aa2b5 could not be found. Aug 27 04:46:25.811387 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-748aba83-0be4-4e63-a69e-e8dcae9d2299 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Returning 404 to user: Instance 9353ffc8-af99-478a-84a7-b3d3c94aa2b5 could not be found. {{(pid=108970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:46:25.812320 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-748aba83-0be4-4e63-a69e-e8dcae9d2299 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/9353ffc8-af99-478a-84a7-b3d3c94aa2b5" status: 404 len: 111 microversion: 2.1 time: 0.032086 Aug 27 04:46:25.813058 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 705/1415] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:46:25 2021] GET /compute/v2.1/servers/9353ffc8-af99-478a-84a7-b3d3c94aa2b5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:46:26.568851 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-46962259-7d7c-4e6d-b570-02152b080aec tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:26.569682 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-46962259-7d7c-4e6d-b570-02152b080aec tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 0e1ad5f4-a543-4d5f-bfcc-521717d219f7] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:46:26.575718 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-46962259-7d7c-4e6d-b570-02152b080aec tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:26.576210 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-46962259-7d7c-4e6d-b570-02152b080aec tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:26.577027 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-46962259-7d7c-4e6d-b570-02152b080aec tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:26.577495 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-46962259-7d7c-4e6d-b570-02152b080aec tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:26.702250 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-46962259-7d7c-4e6d-b570-02152b080aec tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5af28c28d4044fe8b57978dd4b775e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268453b6c33d4cc0a6486da778b00f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:26.711276 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-46962259-7d7c-4e6d-b570-02152b080aec tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/0e1ad5f4-a543-4d5f-bfcc-521717d219f7" status: 200 len: 1451 microversion: 2.1 time: 0.146426 Aug 27 04:46:26.712015 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 711/1416] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:46:26 2021] GET /compute/v2.1/servers/0e1ad5f4-a543-4d5f-bfcc-521717d219f7 => generated 1451 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:26.727538 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-6faffae9-f7e1-42b7-85e3-e064fd76a9f9 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:26.728196 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-6faffae9-f7e1-42b7-85e3-e064fd76a9f9 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 0e1ad5f4-a543-4d5f-bfcc-521717d219f7] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:46:26.734463 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6faffae9-f7e1-42b7-85e3-e064fd76a9f9 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:26.734914 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6faffae9-f7e1-42b7-85e3-e064fd76a9f9 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:26.735706 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6faffae9-f7e1-42b7-85e3-e064fd76a9f9 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:26.736174 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6faffae9-f7e1-42b7-85e3-e064fd76a9f9 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:26.871747 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-6faffae9-f7e1-42b7-85e3-e064fd76a9f9 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5af28c28d4044fe8b57978dd4b775e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268453b6c33d4cc0a6486da778b00f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:26.879400 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-6faffae9-f7e1-42b7-85e3-e064fd76a9f9 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/0e1ad5f4-a543-4d5f-bfcc-521717d219f7" status: 200 len: 1451 microversion: 2.1 time: 0.155453 Aug 27 04:46:26.880006 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 706/1417] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:46:26 2021] GET /compute/v2.1/servers/0e1ad5f4-a543-4d5f-bfcc-521717d219f7 => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:26.953024 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-4630cd30-0563-44e1-8426-ebcd346ea986 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:26.953504 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-4630cd30-0563-44e1-8426-ebcd346ea986 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: 838b77f4-569b-4f66-93f1-083fb5cb5eca] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:46:26.959973 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-4630cd30-0563-44e1-8426-ebcd346ea986 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:26.960455 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-4630cd30-0563-44e1-8426-ebcd346ea986 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:26.961221 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-4630cd30-0563-44e1-8426-ebcd346ea986 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:26.961649 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-4630cd30-0563-44e1-8426-ebcd346ea986 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:26.992888 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-4630cd30-0563-44e1-8426-ebcd346ea986 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: 838b77f4-569b-4f66-93f1-083fb5cb5eca] Going to try to terminate instance {{(pid=108971) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 04:46:27.082700 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-4630cd30-0563-44e1-8426-ebcd346ea986 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "DELETE /compute/v2.1/servers/838b77f4-569b-4f66-93f1-083fb5cb5eca" status: 204 len: 0 microversion: 2.1 time: 0.133009 Aug 27 04:46:27.084033 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 712/1418] 10.222.0.53 () {58 vars in 1239 bytes} [Fri Aug 27 04:46:26 2021] DELETE /compute/v2.1/servers/838b77f4-569b-4f66-93f1-083fb5cb5eca => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:46:27.092536 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-ed913c85-ff1e-4237-85c1-f40eaa343ee4 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:27.093215 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-ed913c85-ff1e-4237-85c1-f40eaa343ee4 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: 838b77f4-569b-4f66-93f1-083fb5cb5eca] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:46:27.099966 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ed913c85-ff1e-4237-85c1-f40eaa343ee4 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:27.100603 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ed913c85-ff1e-4237-85c1-f40eaa343ee4 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:27.101408 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ed913c85-ff1e-4237-85c1-f40eaa343ee4 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:27.101850 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-ed913c85-ff1e-4237-85c1-f40eaa343ee4 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:27.260941 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-ed913c85-ff1e-4237-85c1-f40eaa343ee4 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:27.268567 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-ed913c85-ff1e-4237-85c1-f40eaa343ee4 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/838b77f4-569b-4f66-93f1-083fb5cb5eca" status: 200 len: 1514 microversion: 2.1 time: 0.179999 Aug 27 04:46:27.269148 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 707/1419] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:46:27 2021] GET /compute/v2.1/servers/838b77f4-569b-4f66-93f1-083fb5cb5eca => generated 1514 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:28.290997 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-4bff7cf9-a803-45bc-904e-9889e7865b2f tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:28.291652 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-4bff7cf9-a803-45bc-904e-9889e7865b2f tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: 838b77f4-569b-4f66-93f1-083fb5cb5eca] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:46:28.297561 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-4bff7cf9-a803-45bc-904e-9889e7865b2f tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:28.298015 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-4bff7cf9-a803-45bc-904e-9889e7865b2f tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:28.298787 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-4bff7cf9-a803-45bc-904e-9889e7865b2f tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:28.299225 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-4bff7cf9-a803-45bc-904e-9889e7865b2f tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:28.441366 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-4bff7cf9-a803-45bc-904e-9889e7865b2f tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:28.453274 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-4bff7cf9-a803-45bc-904e-9889e7865b2f tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/838b77f4-569b-4f66-93f1-083fb5cb5eca" status: 200 len: 1514 microversion: 2.1 time: 0.166903 Aug 27 04:46:28.454008 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 713/1420] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:46:28 2021] GET /compute/v2.1/servers/838b77f4-569b-4f66-93f1-083fb5cb5eca => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:29.091800 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [req-8d29b1e6-8998-4974-be1f-10b9631a8195 req-d8c982ae-1f77-496e-886b-c6e9ba077919 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e1ad5f4-a543-4d5f-bfcc-521717d219f7", "tag": "2f4fdbaf-69a6-4d05-be39-30fa63e09ed7"}]} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:46:29.093456 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:46:29.093456 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: warnings.warn(msg) Aug 27 04:46:29.101225 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-8d29b1e6-8998-4974-be1f-10b9631a8195 req-d8c982ae-1f77-496e-886b-c6e9ba077919 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:29.101668 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-8d29b1e6-8998-4974-be1f-10b9631a8195 req-d8c982ae-1f77-496e-886b-c6e9ba077919 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:29.113210 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.compute.server_external_events [req-8d29b1e6-8998-4974-be1f-10b9631a8195 req-d8c982ae-1f77-496e-886b-c6e9ba077919 service nova] Creating event network-changed:2f4fdbaf-69a6-4d05-be39-30fa63e09ed7 for instance 0e1ad5f4-a543-4d5f-bfcc-521717d219f7 on hv-cinder-80403 Aug 27 04:46:29.118165 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [req-8d29b1e6-8998-4974-be1f-10b9631a8195 req-d8c982ae-1f77-496e-886b-c6e9ba077919 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098461 Aug 27 04:46:29.118788 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 708/1421] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:46:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:46:29.470430 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-61c44308-bc4b-40da-a671-a3e7eddc9ea4 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:29.470995 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-61c44308-bc4b-40da-a671-a3e7eddc9ea4 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: 838b77f4-569b-4f66-93f1-083fb5cb5eca] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:46:29.483712 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-61c44308-bc4b-40da-a671-a3e7eddc9ea4 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:29.485317 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-61c44308-bc4b-40da-a671-a3e7eddc9ea4 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:29.487060 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-61c44308-bc4b-40da-a671-a3e7eddc9ea4 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:29.487785 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-61c44308-bc4b-40da-a671-a3e7eddc9ea4 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:29.712550 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-61c44308-bc4b-40da-a671-a3e7eddc9ea4 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:29.727705 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-61c44308-bc4b-40da-a671-a3e7eddc9ea4 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/838b77f4-569b-4f66-93f1-083fb5cb5eca" status: 200 len: 1514 microversion: 2.1 time: 0.261031 Aug 27 04:46:29.729653 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 714/1422] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:46:29 2021] GET /compute/v2.1/servers/838b77f4-569b-4f66-93f1-083fb5cb5eca => generated 1514 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:30.749469 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-eab84820-fdf9-476b-b15f-1fdb049e2677 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:30.750472 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-eab84820-fdf9-476b-b15f-1fdb049e2677 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: 838b77f4-569b-4f66-93f1-083fb5cb5eca] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:46:30.757971 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-eab84820-fdf9-476b-b15f-1fdb049e2677 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:30.758421 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-eab84820-fdf9-476b-b15f-1fdb049e2677 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:30.759204 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-eab84820-fdf9-476b-b15f-1fdb049e2677 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:30.759641 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-eab84820-fdf9-476b-b15f-1fdb049e2677 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:30.773204 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.wsgi [None req-eab84820-fdf9-476b-b15f-1fdb049e2677 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] HTTP exception thrown: Instance 838b77f4-569b-4f66-93f1-083fb5cb5eca could not be found. Aug 27 04:46:30.773791 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-eab84820-fdf9-476b-b15f-1fdb049e2677 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Returning 404 to user: Instance 838b77f4-569b-4f66-93f1-083fb5cb5eca could not be found. {{(pid=108970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:46:30.774640 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-eab84820-fdf9-476b-b15f-1fdb049e2677 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/838b77f4-569b-4f66-93f1-083fb5cb5eca" status: 404 len: 111 microversion: 2.1 time: 0.032116 Aug 27 04:46:30.775710 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 709/1423] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:46:30 2021] GET /compute/v2.1/servers/838b77f4-569b-4f66-93f1-083fb5cb5eca => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:46:30.783339 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-a5f1712f-0c64-4813-b0c0-0aa6cb344ba1 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:30.783853 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-a5f1712f-0c64-4813-b0c0-0aa6cb344ba1 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: b9e15d7c-e87e-45b6-a76b-9562f31480ec] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:46:30.789894 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a5f1712f-0c64-4813-b0c0-0aa6cb344ba1 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:30.790336 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a5f1712f-0c64-4813-b0c0-0aa6cb344ba1 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:30.791103 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a5f1712f-0c64-4813-b0c0-0aa6cb344ba1 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:30.791527 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a5f1712f-0c64-4813-b0c0-0aa6cb344ba1 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:30.818124 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-a5f1712f-0c64-4813-b0c0-0aa6cb344ba1 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: b9e15d7c-e87e-45b6-a76b-9562f31480ec] Going to try to terminate instance {{(pid=108971) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 04:46:30.899831 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-a5f1712f-0c64-4813-b0c0-0aa6cb344ba1 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "DELETE /compute/v2.1/servers/b9e15d7c-e87e-45b6-a76b-9562f31480ec" status: 204 len: 0 microversion: 2.1 time: 0.119768 Aug 27 04:46:30.900537 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 715/1424] 10.222.0.53 () {58 vars in 1239 bytes} [Fri Aug 27 04:46:30 2021] DELETE /compute/v2.1/servers/b9e15d7c-e87e-45b6-a76b-9562f31480ec => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:46:30.908457 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-2b88f638-7c8d-4fda-b98b-9fab1661f863 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:30.909065 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-2b88f638-7c8d-4fda-b98b-9fab1661f863 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: b9e15d7c-e87e-45b6-a76b-9562f31480ec] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:46:30.915615 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2b88f638-7c8d-4fda-b98b-9fab1661f863 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:30.916130 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2b88f638-7c8d-4fda-b98b-9fab1661f863 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:30.917076 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2b88f638-7c8d-4fda-b98b-9fab1661f863 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:30.917506 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2b88f638-7c8d-4fda-b98b-9fab1661f863 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:31.042085 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-2b88f638-7c8d-4fda-b98b-9fab1661f863 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:31.049601 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-2b88f638-7c8d-4fda-b98b-9fab1661f863 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/b9e15d7c-e87e-45b6-a76b-9562f31480ec" status: 200 len: 1512 microversion: 2.1 time: 0.144754 Aug 27 04:46:31.050184 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 710/1425] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:46:30 2021] GET /compute/v2.1/servers/b9e15d7c-e87e-45b6-a76b-9562f31480ec => generated 1512 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:46:31.134370 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [req-2776a9e6-c3e1-4249-a18e-e8c279d1713f req-a7f01610-1061-451f-b1e6-e3ed5240a419 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "838b77f4-569b-4f66-93f1-083fb5cb5eca", "name": "network-vif-deleted", "tag": "ab2e3ac6-490e-4cc6-b0f2-52534543c6f3"}]} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:46:31.135890 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:46:31.135890 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: warnings.warn(msg) Aug 27 04:46:31.142973 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-2776a9e6-c3e1-4249-a18e-e8c279d1713f req-a7f01610-1061-451f-b1e6-e3ed5240a419 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:31.143418 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-2776a9e6-c3e1-4249-a18e-e8c279d1713f req-a7f01610-1061-451f-b1e6-e3ed5240a419 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:31.155313 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.compute.server_external_events [req-2776a9e6-c3e1-4249-a18e-e8c279d1713f req-a7f01610-1061-451f-b1e6-e3ed5240a419 service nova] Creating event network-vif-deleted:ab2e3ac6-490e-4cc6-b0f2-52534543c6f3 for instance 838b77f4-569b-4f66-93f1-083fb5cb5eca on hv-cinder-80403 Aug 27 04:46:31.160119 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [req-2776a9e6-c3e1-4249-a18e-e8c279d1713f req-a7f01610-1061-451f-b1e6-e3ed5240a419 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030359 Aug 27 04:46:31.160742 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 716/1426] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:46:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:46:32.066603 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-d45a85fa-f426-4d8f-a6cc-6b668558aa87 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:32.067217 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-d45a85fa-f426-4d8f-a6cc-6b668558aa87 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: b9e15d7c-e87e-45b6-a76b-9562f31480ec] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:46:32.073432 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d45a85fa-f426-4d8f-a6cc-6b668558aa87 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:32.073882 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d45a85fa-f426-4d8f-a6cc-6b668558aa87 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:32.074672 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d45a85fa-f426-4d8f-a6cc-6b668558aa87 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:32.075114 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-d45a85fa-f426-4d8f-a6cc-6b668558aa87 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:32.216327 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-d45a85fa-f426-4d8f-a6cc-6b668558aa87 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:32.223741 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-d45a85fa-f426-4d8f-a6cc-6b668558aa87 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/b9e15d7c-e87e-45b6-a76b-9562f31480ec" status: 200 len: 1512 microversion: 2.1 time: 0.160803 Aug 27 04:46:32.224367 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 711/1427] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:46:32 2021] GET /compute/v2.1/servers/b9e15d7c-e87e-45b6-a76b-9562f31480ec => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:33.242162 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-356195a9-d3a8-4df2-b7e2-302e30e68e62 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:33.243109 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-356195a9-d3a8-4df2-b7e2-302e30e68e62 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: b9e15d7c-e87e-45b6-a76b-9562f31480ec] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:46:33.251461 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-356195a9-d3a8-4df2-b7e2-302e30e68e62 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:33.251914 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-356195a9-d3a8-4df2-b7e2-302e30e68e62 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:33.252757 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-356195a9-d3a8-4df2-b7e2-302e30e68e62 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:33.253347 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-356195a9-d3a8-4df2-b7e2-302e30e68e62 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:33.395843 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-356195a9-d3a8-4df2-b7e2-302e30e68e62 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:33.403320 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-356195a9-d3a8-4df2-b7e2-302e30e68e62 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/b9e15d7c-e87e-45b6-a76b-9562f31480ec" status: 200 len: 1512 microversion: 2.1 time: 0.165886 Aug 27 04:46:33.404009 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 717/1428] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:46:33 2021] GET /compute/v2.1/servers/b9e15d7c-e87e-45b6-a76b-9562f31480ec => generated 1512 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:33.633022 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [req-0102124e-39e3-4085-b020-a354155d05ea req-b1455ae8-fdb4-4bd6-a72a-70720011d7cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9e15d7c-e87e-45b6-a76b-9562f31480ec", "name": "network-vif-deleted", "tag": "92cbb9c8-5d2b-40f8-bba4-0e8c580aab29"}]} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:46:33.634548 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:46:33.634548 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: warnings.warn(msg) Aug 27 04:46:33.644193 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-0102124e-39e3-4085-b020-a354155d05ea req-b1455ae8-fdb4-4bd6-a72a-70720011d7cc service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:33.644649 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-0102124e-39e3-4085-b020-a354155d05ea req-b1455ae8-fdb4-4bd6-a72a-70720011d7cc service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:33.659592 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.compute.server_external_events [req-0102124e-39e3-4085-b020-a354155d05ea req-b1455ae8-fdb4-4bd6-a72a-70720011d7cc service nova] Creating event network-vif-deleted:92cbb9c8-5d2b-40f8-bba4-0e8c580aab29 for instance b9e15d7c-e87e-45b6-a76b-9562f31480ec on hv-cinder-80403 Aug 27 04:46:33.667530 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [req-0102124e-39e3-4085-b020-a354155d05ea req-b1455ae8-fdb4-4bd6-a72a-70720011d7cc service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037819 Aug 27 04:46:33.668430 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 712/1429] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:46:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:46:34.419730 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-24a0fe7b-7217-4108-b558-8976134fe8b7 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:34.420416 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-24a0fe7b-7217-4108-b558-8976134fe8b7 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: b9e15d7c-e87e-45b6-a76b-9562f31480ec] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:46:34.426453 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-24a0fe7b-7217-4108-b558-8976134fe8b7 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:34.427372 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-24a0fe7b-7217-4108-b558-8976134fe8b7 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:34.428170 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-24a0fe7b-7217-4108-b558-8976134fe8b7 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:34.428607 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-24a0fe7b-7217-4108-b558-8976134fe8b7 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:34.441951 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.wsgi [None req-24a0fe7b-7217-4108-b558-8976134fe8b7 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] HTTP exception thrown: Instance b9e15d7c-e87e-45b6-a76b-9562f31480ec could not be found. Aug 27 04:46:34.443071 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-24a0fe7b-7217-4108-b558-8976134fe8b7 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Returning 404 to user: Instance b9e15d7c-e87e-45b6-a76b-9562f31480ec could not be found. {{(pid=108971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:46:34.443900 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-24a0fe7b-7217-4108-b558-8976134fe8b7 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/b9e15d7c-e87e-45b6-a76b-9562f31480ec" status: 404 len: 111 microversion: 2.1 time: 0.027946 Aug 27 04:46:34.444473 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 718/1430] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:46:34 2021] GET /compute/v2.1/servers/b9e15d7c-e87e-45b6-a76b-9562f31480ec => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:46:35.579629 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-3657336d-f65e-486e-88b8-386054ad6885 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:35.580286 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-3657336d-f65e-486e-88b8-386054ad6885 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: d0f2a3fe-d7cd-448c-bb23-256ac860f4ca] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:46:35.586898 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3657336d-f65e-486e-88b8-386054ad6885 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:35.587415 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3657336d-f65e-486e-88b8-386054ad6885 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:35.588222 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3657336d-f65e-486e-88b8-386054ad6885 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:35.588662 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3657336d-f65e-486e-88b8-386054ad6885 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:35.617031 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-3657336d-f65e-486e-88b8-386054ad6885 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: d0f2a3fe-d7cd-448c-bb23-256ac860f4ca] Going to try to terminate instance {{(pid=108970) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 04:46:35.687778 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-3657336d-f65e-486e-88b8-386054ad6885 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "DELETE /compute/v2.1/servers/d0f2a3fe-d7cd-448c-bb23-256ac860f4ca" status: 204 len: 0 microversion: 2.1 time: 0.111796 Aug 27 04:46:35.688409 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 713/1431] 10.222.0.53 () {58 vars in 1239 bytes} [Fri Aug 27 04:46:35 2021] DELETE /compute/v2.1/servers/d0f2a3fe-d7cd-448c-bb23-256ac860f4ca => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:46:35.696689 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-07f6e7bc-0c1f-46c6-8049-0b24199b7d43 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:35.697297 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-07f6e7bc-0c1f-46c6-8049-0b24199b7d43 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: d0f2a3fe-d7cd-448c-bb23-256ac860f4ca] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:46:35.703298 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-07f6e7bc-0c1f-46c6-8049-0b24199b7d43 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:35.703747 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-07f6e7bc-0c1f-46c6-8049-0b24199b7d43 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:35.704544 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-07f6e7bc-0c1f-46c6-8049-0b24199b7d43 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:35.704986 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-07f6e7bc-0c1f-46c6-8049-0b24199b7d43 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:35.823951 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-07f6e7bc-0c1f-46c6-8049-0b24199b7d43 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:35.831325 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-07f6e7bc-0c1f-46c6-8049-0b24199b7d43 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/d0f2a3fe-d7cd-448c-bb23-256ac860f4ca" status: 200 len: 1515 microversion: 2.1 time: 0.138862 Aug 27 04:46:35.831908 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 719/1432] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:46:35 2021] GET /compute/v2.1/servers/d0f2a3fe-d7cd-448c-bb23-256ac860f4ca => generated 1515 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:36.849531 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-37eb5e28-f6f9-460c-bb32-979b42c8d59a tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:36.850235 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-37eb5e28-f6f9-460c-bb32-979b42c8d59a tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: d0f2a3fe-d7cd-448c-bb23-256ac860f4ca] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:46:36.856387 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-37eb5e28-f6f9-460c-bb32-979b42c8d59a tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:36.856841 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-37eb5e28-f6f9-460c-bb32-979b42c8d59a tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:36.857611 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-37eb5e28-f6f9-460c-bb32-979b42c8d59a tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:36.858053 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-37eb5e28-f6f9-460c-bb32-979b42c8d59a tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:36.981605 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-37eb5e28-f6f9-460c-bb32-979b42c8d59a tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:36.988845 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-37eb5e28-f6f9-460c-bb32-979b42c8d59a tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/d0f2a3fe-d7cd-448c-bb23-256ac860f4ca" status: 200 len: 1515 microversion: 2.1 time: 0.144002 Aug 27 04:46:36.989391 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 714/1433] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:46:36 2021] GET /compute/v2.1/servers/d0f2a3fe-d7cd-448c-bb23-256ac860f4ca => generated 1515 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:38.005890 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-122d0486-4a15-4092-8bd3-0681e39a6472 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:38.006495 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-122d0486-4a15-4092-8bd3-0681e39a6472 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: d0f2a3fe-d7cd-448c-bb23-256ac860f4ca] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:46:38.013722 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-122d0486-4a15-4092-8bd3-0681e39a6472 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:38.014164 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-122d0486-4a15-4092-8bd3-0681e39a6472 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:38.014932 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-122d0486-4a15-4092-8bd3-0681e39a6472 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:38.015361 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-122d0486-4a15-4092-8bd3-0681e39a6472 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:38.136167 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-122d0486-4a15-4092-8bd3-0681e39a6472 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652113b414e74a148274e5658612a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b020e4046e594b05a242175f3df4dec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:46:38.143855 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-122d0486-4a15-4092-8bd3-0681e39a6472 tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/d0f2a3fe-d7cd-448c-bb23-256ac860f4ca" status: 200 len: 1515 microversion: 2.1 time: 0.142205 Aug 27 04:46:38.144464 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 720/1434] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:46:38 2021] GET /compute/v2.1/servers/d0f2a3fe-d7cd-448c-bb23-256ac860f4ca => generated 1515 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:46:38.413843 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [req-c19477e2-2f74-4004-b549-86864e31a9a6 req-7517f442-7897-49b3-8c7e-9e7989ea3b6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0f2a3fe-d7cd-448c-bb23-256ac860f4ca", "name": "network-vif-deleted", "tag": "44778afc-4a60-4718-8d59-c71e3bebde16"}]} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:46:38.415332 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:46:38.415332 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: warnings.warn(msg) Aug 27 04:46:38.422320 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-c19477e2-2f74-4004-b549-86864e31a9a6 req-7517f442-7897-49b3-8c7e-9e7989ea3b6b service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:38.422800 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-c19477e2-2f74-4004-b549-86864e31a9a6 req-7517f442-7897-49b3-8c7e-9e7989ea3b6b service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:38.434358 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.compute.server_external_events [req-c19477e2-2f74-4004-b549-86864e31a9a6 req-7517f442-7897-49b3-8c7e-9e7989ea3b6b service nova] Creating event network-vif-deleted:44778afc-4a60-4718-8d59-c71e3bebde16 for instance d0f2a3fe-d7cd-448c-bb23-256ac860f4ca on hv-cinder-80403 Aug 27 04:46:38.439943 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [req-c19477e2-2f74-4004-b549-86864e31a9a6 req-7517f442-7897-49b3-8c7e-9e7989ea3b6b service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030316 Aug 27 04:46:38.440852 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 715/1435] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:46:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:46:39.164270 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-3907cc1f-6dfb-48ce-83db-d30ff63828ed tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:46:39.164887 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-3907cc1f-6dfb-48ce-83db-d30ff63828ed tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] [instance: d0f2a3fe-d7cd-448c-bb23-256ac860f4ca] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:46:39.170773 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3907cc1f-6dfb-48ce-83db-d30ff63828ed tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:39.171208 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3907cc1f-6dfb-48ce-83db-d30ff63828ed tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:39.172256 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3907cc1f-6dfb-48ce-83db-d30ff63828ed tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:46:39.172746 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3907cc1f-6dfb-48ce-83db-d30ff63828ed tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:46:39.188240 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.wsgi [None req-3907cc1f-6dfb-48ce-83db-d30ff63828ed tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] HTTP exception thrown: Instance d0f2a3fe-d7cd-448c-bb23-256ac860f4ca could not be found. Aug 27 04:46:39.188834 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-3907cc1f-6dfb-48ce-83db-d30ff63828ed tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] Returning 404 to user: Instance d0f2a3fe-d7cd-448c-bb23-256ac860f4ca could not be found. {{(pid=108971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:46:39.189675 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-3907cc1f-6dfb-48ce-83db-d30ff63828ed tempest-AttachVolumeNegativeTest-1116636549 tempest-AttachVolumeNegativeTest-1116636549-project] 10.222.0.53 "GET /compute/v2.1/servers/d0f2a3fe-d7cd-448c-bb23-256ac860f4ca" status: 404 len: 111 microversion: 2.1 time: 0.030655 Aug 27 04:46:39.190227 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 721/1436] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:46:39 2021] GET /compute/v2.1/servers/d0f2a3fe-d7cd-448c-bb23-256ac860f4ca => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:47:02.179781 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-fe0bfbd4-0342-49f7-89cc-7b1c9e0d5fc8 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1882016007", "imageRef": "9356e2fa-e55b-41d9-9ca4-53393f2d79fd", "flavorRef": "452", "networks": [{"uuid": "0d6be377-9fcb-4dba-81fc-8cc85c8d20d0"}]}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:47:02.403717 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.network.neutron [None req-fe0bfbd4-0342-49f7-89cc-7b1c9e0d5fc8 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] validate_networks() for [('0d6be377-9fcb-4dba-81fc-8cc85c8d20d0', None, None, None, None, None)] {{(pid=108970) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 04:47:02.736662 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.virt.hardware [None req-fe0bfbd4-0342-49f7-89cc-7b1c9e0d5fc8 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Flavor limits 0:0:0 {{(pid=108970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:47:02.737085 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.virt.hardware [None req-fe0bfbd4-0342-49f7-89cc-7b1c9e0d5fc8 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Image limits 0:0:0 {{(pid=108970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:47:02.737601 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.virt.hardware [None req-fe0bfbd4-0342-49f7-89cc-7b1c9e0d5fc8 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Flavor pref 0:0:0 {{(pid=108970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:47:02.738010 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.virt.hardware [None req-fe0bfbd4-0342-49f7-89cc-7b1c9e0d5fc8 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Image pref 0:0:0 {{(pid=108970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:47:02.738447 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.virt.hardware [None req-fe0bfbd4-0342-49f7-89cc-7b1c9e0d5fc8 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:47:02.746899 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fe0bfbd4-0342-49f7-89cc-7b1c9e0d5fc8 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:02.747343 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fe0bfbd4-0342-49f7-89cc-7b1c9e0d5fc8 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:02.748180 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fe0bfbd4-0342-49f7-89cc-7b1c9e0d5fc8 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:02.748610 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fe0bfbd4-0342-49f7-89cc-7b1c9e0d5fc8 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:02.764886 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.quota [None req-fe0bfbd4-0342-49f7-89cc-7b1c9e0d5fc8 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Getting quotas for project 7521afb8ad9443b7b3c079e0b31051ab. Resources: {'ram', 'cores', 'instances'} {{(pid=108970) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:47:02.768674 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.quota [None req-fe0bfbd4-0342-49f7-89cc-7b1c9e0d5fc8 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Getting quotas for user 29b3d65ce88a4ce7a7c06d30581996b6 and project 7521afb8ad9443b7b3c079e0b31051ab. Resources: {'ram', 'cores', 'instances'} {{(pid=108970) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:47:02.779454 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-fe0bfbd4-0342-49f7-89cc-7b1c9e0d5fc8 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Going to run 1 instances... {{(pid=108970) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 04:47:02.781852 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-fe0bfbd4-0342-49f7-89cc-7b1c9e0d5fc8 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] [instance: 9892b9b8-1d6c-45d7-ab74-13203937a555] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9356e2fa-e55b-41d9-9ca4-53393f2d79fd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 04:47:02.827957 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-fe0bfbd4-0342-49f7-89cc-7b1c9e0d5fc8 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] 10.222.0.53 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.650673 Aug 27 04:47:02.827957 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 716/1437] 10.222.0.53 () {60 vars in 1147 bytes} [Fri Aug 27 04:47:02 2021] POST /compute/v2.1/servers => generated 380 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:47:02.837163 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-259172cd-27a7-4800-a2e5-21ff0261669e tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:02.837975 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-259172cd-27a7-4800-a2e5-21ff0261669e tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] [instance: 9892b9b8-1d6c-45d7-ab74-13203937a555] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:47:02.949615 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-259172cd-27a7-4800-a2e5-21ff0261669e tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b3d65ce88a4ce7a7c06d30581996b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7521afb8ad9443b7b3c079e0b31051ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:02.957075 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-259172cd-27a7-4800-a2e5-21ff0261669e tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] 10.222.0.53 "GET /compute/v2.1/servers/9892b9b8-1d6c-45d7-ab74-13203937a555" status: 200 len: 1214 microversion: 2.1 time: 0.124311 Aug 27 04:47:02.957718 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 722/1438] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:47:02 2021] GET /compute/v2.1/servers/9892b9b8-1d6c-45d7-ab74-13203937a555 => generated 1214 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:03.974805 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-500df7a1-fc03-4dd4-97fc-c9eeec2f855b tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:03.975531 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-500df7a1-fc03-4dd4-97fc-c9eeec2f855b tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] [instance: 9892b9b8-1d6c-45d7-ab74-13203937a555] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:47:03.982287 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-500df7a1-fc03-4dd4-97fc-c9eeec2f855b tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:03.982731 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-500df7a1-fc03-4dd4-97fc-c9eeec2f855b tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:03.983507 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-500df7a1-fc03-4dd4-97fc-c9eeec2f855b tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:03.983941 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-500df7a1-fc03-4dd4-97fc-c9eeec2f855b tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:04.054400 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-500df7a1-fc03-4dd4-97fc-c9eeec2f855b tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b3d65ce88a4ce7a7c06d30581996b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7521afb8ad9443b7b3c079e0b31051ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:04.061940 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-500df7a1-fc03-4dd4-97fc-c9eeec2f855b tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] 10.222.0.53 "GET /compute/v2.1/servers/9892b9b8-1d6c-45d7-ab74-13203937a555" status: 200 len: 1272 microversion: 2.1 time: 0.091201 Aug 27 04:47:04.062520 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 717/1439] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:47:03 2021] GET /compute/v2.1/servers/9892b9b8-1d6c-45d7-ab74-13203937a555 => generated 1272 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:05.078589 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-d126c72c-3d0b-4484-ad92-5978c2ed2c93 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:05.079326 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-d126c72c-3d0b-4484-ad92-5978c2ed2c93 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] [instance: 9892b9b8-1d6c-45d7-ab74-13203937a555] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:47:05.085662 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d126c72c-3d0b-4484-ad92-5978c2ed2c93 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:05.086178 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d126c72c-3d0b-4484-ad92-5978c2ed2c93 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:05.086941 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d126c72c-3d0b-4484-ad92-5978c2ed2c93 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:05.087367 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d126c72c-3d0b-4484-ad92-5978c2ed2c93 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:05.211906 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-d126c72c-3d0b-4484-ad92-5978c2ed2c93 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b3d65ce88a4ce7a7c06d30581996b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7521afb8ad9443b7b3c079e0b31051ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:05.219338 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-d126c72c-3d0b-4484-ad92-5978c2ed2c93 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] 10.222.0.53 "GET /compute/v2.1/servers/9892b9b8-1d6c-45d7-ab74-13203937a555" status: 200 len: 1314 microversion: 2.1 time: 0.144423 Aug 27 04:47:05.220155 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 723/1440] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:47:05 2021] GET /compute/v2.1/servers/9892b9b8-1d6c-45d7-ab74-13203937a555 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:05.317554 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [req-5346878d-20e1-465c-a785-92c03de08b5f req-da065c0f-086c-4009-8ca1-f72213af26ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9892b9b8-1d6c-45d7-ab74-13203937a555", "tag": "349191aa-5b80-4149-9427-6ccb92fb47ac"}]} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:47:05.319877 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:47:05.319877 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: warnings.warn(msg) Aug 27 04:47:05.327683 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-5346878d-20e1-465c-a785-92c03de08b5f req-da065c0f-086c-4009-8ca1-f72213af26ce service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:05.328833 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-5346878d-20e1-465c-a785-92c03de08b5f req-da065c0f-086c-4009-8ca1-f72213af26ce service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:05.342429 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.compute.server_external_events [req-5346878d-20e1-465c-a785-92c03de08b5f req-da065c0f-086c-4009-8ca1-f72213af26ce service nova] Creating event network-changed:349191aa-5b80-4149-9427-6ccb92fb47ac for instance 9892b9b8-1d6c-45d7-ab74-13203937a555 on hv-cinder-80403 Aug 27 04:47:05.347356 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [req-5346878d-20e1-465c-a785-92c03de08b5f req-da065c0f-086c-4009-8ca1-f72213af26ce service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034170 Aug 27 04:47:05.347971 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 718/1441] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:47:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:47:06.236651 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-e203ada8-8812-45f8-80de-4aa358331ea5 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:06.237182 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-e203ada8-8812-45f8-80de-4aa358331ea5 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] [instance: 9892b9b8-1d6c-45d7-ab74-13203937a555] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:47:06.243495 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e203ada8-8812-45f8-80de-4aa358331ea5 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:06.243944 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e203ada8-8812-45f8-80de-4aa358331ea5 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:06.244735 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e203ada8-8812-45f8-80de-4aa358331ea5 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:06.245167 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-e203ada8-8812-45f8-80de-4aa358331ea5 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:06.362368 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-e203ada8-8812-45f8-80de-4aa358331ea5 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b3d65ce88a4ce7a7c06d30581996b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7521afb8ad9443b7b3c079e0b31051ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:06.370249 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-e203ada8-8812-45f8-80de-4aa358331ea5 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] 10.222.0.53 "GET /compute/v2.1/servers/9892b9b8-1d6c-45d7-ab74-13203937a555" status: 200 len: 1314 microversion: 2.1 time: 0.137347 Aug 27 04:47:06.370808 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 724/1442] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:47:06 2021] GET /compute/v2.1/servers/9892b9b8-1d6c-45d7-ab74-13203937a555 => generated 1314 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:07.387041 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-eaadadd5-1916-4922-a061-87ebe81cf0fa tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:07.387766 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-eaadadd5-1916-4922-a061-87ebe81cf0fa tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] [instance: 9892b9b8-1d6c-45d7-ab74-13203937a555] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:47:07.393770 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-eaadadd5-1916-4922-a061-87ebe81cf0fa tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:07.394216 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-eaadadd5-1916-4922-a061-87ebe81cf0fa tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:07.395076 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-eaadadd5-1916-4922-a061-87ebe81cf0fa tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:07.395579 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-eaadadd5-1916-4922-a061-87ebe81cf0fa tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:07.517468 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-eaadadd5-1916-4922-a061-87ebe81cf0fa tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b3d65ce88a4ce7a7c06d30581996b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7521afb8ad9443b7b3c079e0b31051ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:07.525671 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-eaadadd5-1916-4922-a061-87ebe81cf0fa tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] 10.222.0.53 "GET /compute/v2.1/servers/9892b9b8-1d6c-45d7-ab74-13203937a555" status: 200 len: 1314 microversion: 2.1 time: 0.142751 Aug 27 04:47:07.526238 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 719/1443] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:47:07 2021] GET /compute/v2.1/servers/9892b9b8-1d6c-45d7-ab74-13203937a555 => generated 1314 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:08.542278 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-3ec80176-9373-4b4b-b08f-315a9c422e04 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:08.542884 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-3ec80176-9373-4b4b-b08f-315a9c422e04 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] [instance: 9892b9b8-1d6c-45d7-ab74-13203937a555] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:47:08.548749 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3ec80176-9373-4b4b-b08f-315a9c422e04 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:08.549191 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3ec80176-9373-4b4b-b08f-315a9c422e04 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:08.549942 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3ec80176-9373-4b4b-b08f-315a9c422e04 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:08.550372 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3ec80176-9373-4b4b-b08f-315a9c422e04 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:08.672806 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-3ec80176-9373-4b4b-b08f-315a9c422e04 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b3d65ce88a4ce7a7c06d30581996b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7521afb8ad9443b7b3c079e0b31051ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:08.680496 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-3ec80176-9373-4b4b-b08f-315a9c422e04 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] 10.222.0.53 "GET /compute/v2.1/servers/9892b9b8-1d6c-45d7-ab74-13203937a555" status: 200 len: 1314 microversion: 2.1 time: 0.141909 Aug 27 04:47:08.681057 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 725/1444] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:47:08 2021] GET /compute/v2.1/servers/9892b9b8-1d6c-45d7-ab74-13203937a555 => generated 1314 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:09.697214 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-aee2fcbd-c6fe-42e0-ab0f-a8b2cd201083 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:09.697848 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-aee2fcbd-c6fe-42e0-ab0f-a8b2cd201083 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] [instance: 9892b9b8-1d6c-45d7-ab74-13203937a555] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:47:09.703753 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-aee2fcbd-c6fe-42e0-ab0f-a8b2cd201083 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:09.704313 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-aee2fcbd-c6fe-42e0-ab0f-a8b2cd201083 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:09.705118 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-aee2fcbd-c6fe-42e0-ab0f-a8b2cd201083 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:09.705562 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-aee2fcbd-c6fe-42e0-ab0f-a8b2cd201083 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:09.832078 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-aee2fcbd-c6fe-42e0-ab0f-a8b2cd201083 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b3d65ce88a4ce7a7c06d30581996b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7521afb8ad9443b7b3c079e0b31051ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:09.840090 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-aee2fcbd-c6fe-42e0-ab0f-a8b2cd201083 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] 10.222.0.53 "GET /compute/v2.1/servers/9892b9b8-1d6c-45d7-ab74-13203937a555" status: 200 len: 1314 microversion: 2.1 time: 0.146709 Aug 27 04:47:09.840667 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 720/1445] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:47:09 2021] GET /compute/v2.1/servers/9892b9b8-1d6c-45d7-ab74-13203937a555 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:10.856909 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-2ef1d4c2-5bf9-41be-b593-b4d3552856d6 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:10.857550 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-2ef1d4c2-5bf9-41be-b593-b4d3552856d6 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] [instance: 9892b9b8-1d6c-45d7-ab74-13203937a555] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:47:10.863462 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-2ef1d4c2-5bf9-41be-b593-b4d3552856d6 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:10.863916 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-2ef1d4c2-5bf9-41be-b593-b4d3552856d6 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:10.864734 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-2ef1d4c2-5bf9-41be-b593-b4d3552856d6 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:10.865794 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-2ef1d4c2-5bf9-41be-b593-b4d3552856d6 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:10.990409 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-2ef1d4c2-5bf9-41be-b593-b4d3552856d6 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b3d65ce88a4ce7a7c06d30581996b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7521afb8ad9443b7b3c079e0b31051ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:10.997868 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-2ef1d4c2-5bf9-41be-b593-b4d3552856d6 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] 10.222.0.53 "GET /compute/v2.1/servers/9892b9b8-1d6c-45d7-ab74-13203937a555" status: 200 len: 1314 microversion: 2.1 time: 0.144866 Aug 27 04:47:10.998443 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 726/1446] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:47:10 2021] GET /compute/v2.1/servers/9892b9b8-1d6c-45d7-ab74-13203937a555 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:11.791773 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [req-a9836c1e-5d88-4b5e-9417-36eba2e6ec6d req-a3260851-b859-4af4-a88c-51bc0e110d84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9892b9b8-1d6c-45d7-ab74-13203937a555", "name": "network-vif-plugged", "status": "completed", "tag": "349191aa-5b80-4149-9427-6ccb92fb47ac"}]} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:47:11.793987 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:47:11.793987 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: warnings.warn(msg) Aug 27 04:47:11.801514 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-a9836c1e-5d88-4b5e-9417-36eba2e6ec6d req-a3260851-b859-4af4-a88c-51bc0e110d84 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:11.801961 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-a9836c1e-5d88-4b5e-9417-36eba2e6ec6d req-a3260851-b859-4af4-a88c-51bc0e110d84 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:11.815318 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.compute.server_external_events [req-a9836c1e-5d88-4b5e-9417-36eba2e6ec6d req-a3260851-b859-4af4-a88c-51bc0e110d84 service nova] Creating event network-vif-plugged:349191aa-5b80-4149-9427-6ccb92fb47ac for instance 9892b9b8-1d6c-45d7-ab74-13203937a555 on hv-cinder-80403 Aug 27 04:47:11.821400 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [req-a9836c1e-5d88-4b5e-9417-36eba2e6ec6d req-a3260851-b859-4af4-a88c-51bc0e110d84 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033093 Aug 27 04:47:11.822153 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 721/1447] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:47:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:47:12.013989 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-eaa23152-157a-4af0-801f-41972e9e5fab tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:12.014577 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-eaa23152-157a-4af0-801f-41972e9e5fab tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] [instance: 9892b9b8-1d6c-45d7-ab74-13203937a555] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:47:12.020716 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-eaa23152-157a-4af0-801f-41972e9e5fab tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:12.021165 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-eaa23152-157a-4af0-801f-41972e9e5fab tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:12.022452 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-eaa23152-157a-4af0-801f-41972e9e5fab tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:12.022885 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-eaa23152-157a-4af0-801f-41972e9e5fab tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:12.141954 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-eaa23152-157a-4af0-801f-41972e9e5fab tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b3d65ce88a4ce7a7c06d30581996b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7521afb8ad9443b7b3c079e0b31051ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:12.150167 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-eaa23152-157a-4af0-801f-41972e9e5fab tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] 10.222.0.53 "GET /compute/v2.1/servers/9892b9b8-1d6c-45d7-ab74-13203937a555" status: 200 len: 1314 microversion: 2.1 time: 0.139987 Aug 27 04:47:12.150738 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 727/1448] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:47:12 2021] GET /compute/v2.1/servers/9892b9b8-1d6c-45d7-ab74-13203937a555 => generated 1314 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:13.169641 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-3f510b75-e8ab-4243-82e0-33de9e8f5525 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:13.170355 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-3f510b75-e8ab-4243-82e0-33de9e8f5525 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] [instance: 9892b9b8-1d6c-45d7-ab74-13203937a555] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:47:13.177137 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3f510b75-e8ab-4243-82e0-33de9e8f5525 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:13.178527 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3f510b75-e8ab-4243-82e0-33de9e8f5525 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:13.179005 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3f510b75-e8ab-4243-82e0-33de9e8f5525 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:13.180057 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-3f510b75-e8ab-4243-82e0-33de9e8f5525 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:13.304411 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-3f510b75-e8ab-4243-82e0-33de9e8f5525 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b3d65ce88a4ce7a7c06d30581996b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7521afb8ad9443b7b3c079e0b31051ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:13.311669 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-3f510b75-e8ab-4243-82e0-33de9e8f5525 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] 10.222.0.53 "GET /compute/v2.1/servers/9892b9b8-1d6c-45d7-ab74-13203937a555" status: 200 len: 1314 microversion: 2.1 time: 0.147766 Aug 27 04:47:13.312264 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 722/1449] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:47:13 2021] GET /compute/v2.1/servers/9892b9b8-1d6c-45d7-ab74-13203937a555 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:14.328320 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-28e0a39e-302b-44cd-963b-fd8568408adf tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:14.328976 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-28e0a39e-302b-44cd-963b-fd8568408adf tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] [instance: 9892b9b8-1d6c-45d7-ab74-13203937a555] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:47:14.335504 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-28e0a39e-302b-44cd-963b-fd8568408adf tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:14.335954 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-28e0a39e-302b-44cd-963b-fd8568408adf tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:14.336745 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-28e0a39e-302b-44cd-963b-fd8568408adf tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:14.337183 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-28e0a39e-302b-44cd-963b-fd8568408adf tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:14.455758 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-28e0a39e-302b-44cd-963b-fd8568408adf tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b3d65ce88a4ce7a7c06d30581996b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7521afb8ad9443b7b3c079e0b31051ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:14.463626 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-28e0a39e-302b-44cd-963b-fd8568408adf tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] 10.222.0.53 "GET /compute/v2.1/servers/9892b9b8-1d6c-45d7-ab74-13203937a555" status: 200 len: 1497 microversion: 2.1 time: 0.138988 Aug 27 04:47:14.464233 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 728/1450] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:47:14 2021] GET /compute/v2.1/servers/9892b9b8-1d6c-45d7-ab74-13203937a555 => generated 1497 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:14.965958 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-bc695d8f-d4c9-4a47-b6a0-68a437c7aef9 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:14.966462 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-bc695d8f-d4c9-4a47-b6a0-68a437c7aef9 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] [instance: 9892b9b8-1d6c-45d7-ab74-13203937a555] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:47:14.972247 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-bc695d8f-d4c9-4a47-b6a0-68a437c7aef9 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:14.972715 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-bc695d8f-d4c9-4a47-b6a0-68a437c7aef9 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:14.973508 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-bc695d8f-d4c9-4a47-b6a0-68a437c7aef9 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:14.973974 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-bc695d8f-d4c9-4a47-b6a0-68a437c7aef9 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:15.000605 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-bc695d8f-d4c9-4a47-b6a0-68a437c7aef9 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] [instance: 9892b9b8-1d6c-45d7-ab74-13203937a555] Going to try to terminate instance {{(pid=108970) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 04:47:15.072477 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-bc695d8f-d4c9-4a47-b6a0-68a437c7aef9 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] 10.222.0.53 "DELETE /compute/v2.1/servers/9892b9b8-1d6c-45d7-ab74-13203937a555" status: 204 len: 0 microversion: 2.1 time: 0.109924 Aug 27 04:47:15.073283 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 723/1451] 10.222.0.53 () {58 vars in 1239 bytes} [Fri Aug 27 04:47:14 2021] DELETE /compute/v2.1/servers/9892b9b8-1d6c-45d7-ab74-13203937a555 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:47:15.081729 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-38d3f817-98e7-4d10-ad1f-71bca214dd97 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:15.082348 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-38d3f817-98e7-4d10-ad1f-71bca214dd97 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] [instance: 9892b9b8-1d6c-45d7-ab74-13203937a555] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:47:15.088847 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-38d3f817-98e7-4d10-ad1f-71bca214dd97 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:15.089287 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-38d3f817-98e7-4d10-ad1f-71bca214dd97 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:15.090053 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-38d3f817-98e7-4d10-ad1f-71bca214dd97 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:15.090487 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-38d3f817-98e7-4d10-ad1f-71bca214dd97 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:15.213009 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-38d3f817-98e7-4d10-ad1f-71bca214dd97 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b3d65ce88a4ce7a7c06d30581996b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7521afb8ad9443b7b3c079e0b31051ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:15.220362 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-38d3f817-98e7-4d10-ad1f-71bca214dd97 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] 10.222.0.53 "GET /compute/v2.1/servers/9892b9b8-1d6c-45d7-ab74-13203937a555" status: 200 len: 1503 microversion: 2.1 time: 0.142274 Aug 27 04:47:15.220864 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 729/1452] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:47:15 2021] GET /compute/v2.1/servers/9892b9b8-1d6c-45d7-ab74-13203937a555 => generated 1503 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:16.238631 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-7b8c670d-159a-4216-8c85-548511ed8ee3 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:16.239342 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-7b8c670d-159a-4216-8c85-548511ed8ee3 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] [instance: 9892b9b8-1d6c-45d7-ab74-13203937a555] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:47:16.245312 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7b8c670d-159a-4216-8c85-548511ed8ee3 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:16.245766 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7b8c670d-159a-4216-8c85-548511ed8ee3 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:16.246535 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7b8c670d-159a-4216-8c85-548511ed8ee3 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:16.246975 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7b8c670d-159a-4216-8c85-548511ed8ee3 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:16.369432 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-7b8c670d-159a-4216-8c85-548511ed8ee3 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b3d65ce88a4ce7a7c06d30581996b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7521afb8ad9443b7b3c079e0b31051ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:16.376789 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-7b8c670d-159a-4216-8c85-548511ed8ee3 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] 10.222.0.53 "GET /compute/v2.1/servers/9892b9b8-1d6c-45d7-ab74-13203937a555" status: 200 len: 1503 microversion: 2.1 time: 0.142161 Aug 27 04:47:16.377361 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 724/1453] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:47:16 2021] GET /compute/v2.1/servers/9892b9b8-1d6c-45d7-ab74-13203937a555 => generated 1503 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:17.331385 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [req-9b4998ab-576b-4cc7-88b1-c2c32465348f req-69bf817d-63fc-4b1b-a162-85fe0ea49803 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9892b9b8-1d6c-45d7-ab74-13203937a555", "name": "network-vif-deleted", "tag": "349191aa-5b80-4149-9427-6ccb92fb47ac"}]} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:47:17.333053 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:47:17.333053 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: warnings.warn(msg) Aug 27 04:47:17.341270 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-9b4998ab-576b-4cc7-88b1-c2c32465348f req-69bf817d-63fc-4b1b-a162-85fe0ea49803 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:17.341816 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-9b4998ab-576b-4cc7-88b1-c2c32465348f req-69bf817d-63fc-4b1b-a162-85fe0ea49803 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:17.355896 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.compute.server_external_events [req-9b4998ab-576b-4cc7-88b1-c2c32465348f req-69bf817d-63fc-4b1b-a162-85fe0ea49803 service nova] Creating event network-vif-deleted:349191aa-5b80-4149-9427-6ccb92fb47ac for instance 9892b9b8-1d6c-45d7-ab74-13203937a555 on hv-cinder-80403 Aug 27 04:47:17.360990 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [req-9b4998ab-576b-4cc7-88b1-c2c32465348f req-69bf817d-63fc-4b1b-a162-85fe0ea49803 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033488 Aug 27 04:47:17.361804 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 730/1454] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:47:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:47:17.394066 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-fe529716-676f-495c-929b-833a5881437b tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:17.394665 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-fe529716-676f-495c-929b-833a5881437b tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] [instance: 9892b9b8-1d6c-45d7-ab74-13203937a555] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:47:17.401754 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fe529716-676f-495c-929b-833a5881437b tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:17.402171 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fe529716-676f-495c-929b-833a5881437b tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:17.403350 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fe529716-676f-495c-929b-833a5881437b tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:17.403795 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-fe529716-676f-495c-929b-833a5881437b tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:17.465900 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-fe529716-676f-495c-929b-833a5881437b tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b3d65ce88a4ce7a7c06d30581996b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7521afb8ad9443b7b3c079e0b31051ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:17.473306 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-fe529716-676f-495c-929b-833a5881437b tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] 10.222.0.53 "GET /compute/v2.1/servers/9892b9b8-1d6c-45d7-ab74-13203937a555" status: 200 len: 1299 microversion: 2.1 time: 0.082981 Aug 27 04:47:17.473888 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 725/1455] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:47:17 2021] GET /compute/v2.1/servers/9892b9b8-1d6c-45d7-ab74-13203937a555 => generated 1299 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:18.490975 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-92ceee58-d69a-48f3-b9fd-1a417334f59d tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:18.491588 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-92ceee58-d69a-48f3-b9fd-1a417334f59d tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] [instance: 9892b9b8-1d6c-45d7-ab74-13203937a555] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:47:18.497983 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-92ceee58-d69a-48f3-b9fd-1a417334f59d tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:18.498437 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-92ceee58-d69a-48f3-b9fd-1a417334f59d tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:18.499224 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-92ceee58-d69a-48f3-b9fd-1a417334f59d tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:18.499661 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-92ceee58-d69a-48f3-b9fd-1a417334f59d tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:18.512510 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.wsgi [None req-92ceee58-d69a-48f3-b9fd-1a417334f59d tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] HTTP exception thrown: Instance 9892b9b8-1d6c-45d7-ab74-13203937a555 could not be found. Aug 27 04:47:18.513095 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-92ceee58-d69a-48f3-b9fd-1a417334f59d tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Returning 404 to user: Instance 9892b9b8-1d6c-45d7-ab74-13203937a555 could not be found. {{(pid=108971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:47:18.513914 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-92ceee58-d69a-48f3-b9fd-1a417334f59d tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] 10.222.0.53 "GET /compute/v2.1/servers/9892b9b8-1d6c-45d7-ab74-13203937a555" status: 404 len: 111 microversion: 2.1 time: 0.027056 Aug 27 04:47:18.514438 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 731/1456] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:47:18 2021] GET /compute/v2.1/servers/9892b9b8-1d6c-45d7-ab74-13203937a555 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:47:18.560579 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-de469e4f-67eb-4c0d-802e-4431346bfddb tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1591895541", "imageRef": "9356e2fa-e55b-41d9-9ca4-53393f2d79fd", "flavorRef": "452", "networks": [{"uuid": "0d6be377-9fcb-4dba-81fc-8cc85c8d20d0"}]}} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:47:18.610312 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.network.neutron [None req-de469e4f-67eb-4c0d-802e-4431346bfddb tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] validate_networks() for [('0d6be377-9fcb-4dba-81fc-8cc85c8d20d0', None, None, None, None, None)] {{(pid=108970) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 04:47:18.949888 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.virt.hardware [None req-de469e4f-67eb-4c0d-802e-4431346bfddb tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Flavor limits 0:0:0 {{(pid=108970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:47:18.950321 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.virt.hardware [None req-de469e4f-67eb-4c0d-802e-4431346bfddb tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Image limits 0:0:0 {{(pid=108970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:47:18.950798 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.virt.hardware [None req-de469e4f-67eb-4c0d-802e-4431346bfddb tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Flavor pref 0:0:0 {{(pid=108970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:47:18.951243 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.virt.hardware [None req-de469e4f-67eb-4c0d-802e-4431346bfddb tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Image pref 0:0:0 {{(pid=108970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:47:18.951655 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.virt.hardware [None req-de469e4f-67eb-4c0d-802e-4431346bfddb tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:47:18.961070 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-de469e4f-67eb-4c0d-802e-4431346bfddb tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:18.961516 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-de469e4f-67eb-4c0d-802e-4431346bfddb tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:18.962321 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-de469e4f-67eb-4c0d-802e-4431346bfddb tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:18.962759 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-de469e4f-67eb-4c0d-802e-4431346bfddb tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:18.980689 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.quota [None req-de469e4f-67eb-4c0d-802e-4431346bfddb tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Getting quotas for project 7521afb8ad9443b7b3c079e0b31051ab. Resources: {'ram', 'cores', 'instances'} {{(pid=108970) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:47:18.984753 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.quota [None req-de469e4f-67eb-4c0d-802e-4431346bfddb tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Getting quotas for user 29b3d65ce88a4ce7a7c06d30581996b6 and project 7521afb8ad9443b7b3c079e0b31051ab. Resources: {'ram', 'cores', 'instances'} {{(pid=108970) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:47:18.996294 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-de469e4f-67eb-4c0d-802e-4431346bfddb tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Going to run 1 instances... {{(pid=108970) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 04:47:18.998601 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-de469e4f-67eb-4c0d-802e-4431346bfddb tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] [instance: c74e9509-ca7f-47ee-8451-2f86991633da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9356e2fa-e55b-41d9-9ca4-53393f2d79fd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 04:47:19.044348 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-de469e4f-67eb-4c0d-802e-4431346bfddb tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] 10.222.0.53 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.487186 Aug 27 04:47:19.044918 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 726/1457] 10.222.0.53 () {60 vars in 1147 bytes} [Fri Aug 27 04:47:18 2021] POST /compute/v2.1/servers => generated 380 bytes in 489 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:47:19.055663 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-bb4a66bd-42de-4bb1-90c3-0a4a50e69893 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:19.056562 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-bb4a66bd-42de-4bb1-90c3-0a4a50e69893 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] [instance: c74e9509-ca7f-47ee-8451-2f86991633da] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:47:19.112702 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-bb4a66bd-42de-4bb1-90c3-0a4a50e69893 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b3d65ce88a4ce7a7c06d30581996b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7521afb8ad9443b7b3c079e0b31051ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:19.120187 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-bb4a66bd-42de-4bb1-90c3-0a4a50e69893 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] 10.222.0.53 "GET /compute/v2.1/servers/c74e9509-ca7f-47ee-8451-2f86991633da" status: 200 len: 1214 microversion: 2.1 time: 0.069165 Aug 27 04:47:19.121023 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 732/1458] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:47:19 2021] GET /compute/v2.1/servers/c74e9509-ca7f-47ee-8451-2f86991633da => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:20.137456 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-17527812-613e-4ef1-8177-83319bc4241a tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:20.138076 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-17527812-613e-4ef1-8177-83319bc4241a tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] [instance: c74e9509-ca7f-47ee-8451-2f86991633da] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:47:20.144201 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-17527812-613e-4ef1-8177-83319bc4241a tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:20.144665 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-17527812-613e-4ef1-8177-83319bc4241a tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:20.145447 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-17527812-613e-4ef1-8177-83319bc4241a tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:20.145892 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-17527812-613e-4ef1-8177-83319bc4241a tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:20.243377 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-17527812-613e-4ef1-8177-83319bc4241a tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b3d65ce88a4ce7a7c06d30581996b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7521afb8ad9443b7b3c079e0b31051ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:20.250874 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-17527812-613e-4ef1-8177-83319bc4241a tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] 10.222.0.53 "GET /compute/v2.1/servers/c74e9509-ca7f-47ee-8451-2f86991633da" status: 200 len: 1272 microversion: 2.1 time: 0.117054 Aug 27 04:47:20.251587 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 727/1459] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:47:20 2021] GET /compute/v2.1/servers/c74e9509-ca7f-47ee-8451-2f86991633da => generated 1272 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:21.268702 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-51394274-26b9-4bdd-b238-892193742427 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:21.269380 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-51394274-26b9-4bdd-b238-892193742427 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] [instance: c74e9509-ca7f-47ee-8451-2f86991633da] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:47:21.275586 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-51394274-26b9-4bdd-b238-892193742427 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:21.276057 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-51394274-26b9-4bdd-b238-892193742427 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:21.276905 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-51394274-26b9-4bdd-b238-892193742427 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:21.277283 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-51394274-26b9-4bdd-b238-892193742427 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:21.403443 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-51394274-26b9-4bdd-b238-892193742427 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b3d65ce88a4ce7a7c06d30581996b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7521afb8ad9443b7b3c079e0b31051ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:21.415421 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-51394274-26b9-4bdd-b238-892193742427 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] 10.222.0.53 "GET /compute/v2.1/servers/c74e9509-ca7f-47ee-8451-2f86991633da" status: 200 len: 1314 microversion: 2.1 time: 0.150483 Aug 27 04:47:21.416051 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 733/1460] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:47:21 2021] GET /compute/v2.1/servers/c74e9509-ca7f-47ee-8451-2f86991633da => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:47:21.458014 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [req-e2b2182e-9e65-4ecc-a46f-37b9cb1a7d41 req-16c99f60-593e-42a9-8d37-b80409384df8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c74e9509-ca7f-47ee-8451-2f86991633da", "tag": "d471ea0f-bc2f-4abf-8816-365135714c4a"}]} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:47:21.462359 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:47:21.462359 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: warnings.warn(msg) Aug 27 04:47:21.472599 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-e2b2182e-9e65-4ecc-a46f-37b9cb1a7d41 req-16c99f60-593e-42a9-8d37-b80409384df8 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:21.473163 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-e2b2182e-9e65-4ecc-a46f-37b9cb1a7d41 req-16c99f60-593e-42a9-8d37-b80409384df8 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:21.489504 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.compute.server_external_events [req-e2b2182e-9e65-4ecc-a46f-37b9cb1a7d41 req-16c99f60-593e-42a9-8d37-b80409384df8 service nova] Creating event network-changed:d471ea0f-bc2f-4abf-8816-365135714c4a for instance c74e9509-ca7f-47ee-8451-2f86991633da on hv-cinder-80403 Aug 27 04:47:21.506043 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [req-e2b2182e-9e65-4ecc-a46f-37b9cb1a7d41 req-16c99f60-593e-42a9-8d37-b80409384df8 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052902 Aug 27 04:47:21.506672 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 728/1461] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:47:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:47:22.432674 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-facd3fc5-bb1d-49f3-b27a-77743959a7c2 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:22.433291 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-facd3fc5-bb1d-49f3-b27a-77743959a7c2 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] [instance: c74e9509-ca7f-47ee-8451-2f86991633da] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:47:22.439342 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-facd3fc5-bb1d-49f3-b27a-77743959a7c2 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:22.439798 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-facd3fc5-bb1d-49f3-b27a-77743959a7c2 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:22.440603 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-facd3fc5-bb1d-49f3-b27a-77743959a7c2 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:22.441041 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-facd3fc5-bb1d-49f3-b27a-77743959a7c2 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:22.820301 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-facd3fc5-bb1d-49f3-b27a-77743959a7c2 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b3d65ce88a4ce7a7c06d30581996b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7521afb8ad9443b7b3c079e0b31051ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:22.827515 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-facd3fc5-bb1d-49f3-b27a-77743959a7c2 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] 10.222.0.53 "GET /compute/v2.1/servers/c74e9509-ca7f-47ee-8451-2f86991633da" status: 200 len: 1314 microversion: 2.1 time: 0.398548 Aug 27 04:47:22.828205 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 734/1462] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:47:22 2021] GET /compute/v2.1/servers/c74e9509-ca7f-47ee-8451-2f86991633da => generated 1314 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:23.848125 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-79008d76-358d-4efb-9cae-8480490c1c3d tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:23.849982 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-79008d76-358d-4efb-9cae-8480490c1c3d tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] [instance: c74e9509-ca7f-47ee-8451-2f86991633da] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:47:23.857498 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-79008d76-358d-4efb-9cae-8480490c1c3d tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:23.857942 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-79008d76-358d-4efb-9cae-8480490c1c3d tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:23.858715 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-79008d76-358d-4efb-9cae-8480490c1c3d tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:23.859147 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-79008d76-358d-4efb-9cae-8480490c1c3d tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:23.991752 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-79008d76-358d-4efb-9cae-8480490c1c3d tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b3d65ce88a4ce7a7c06d30581996b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7521afb8ad9443b7b3c079e0b31051ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:23.999337 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-79008d76-358d-4efb-9cae-8480490c1c3d tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] 10.222.0.53 "GET /compute/v2.1/servers/c74e9509-ca7f-47ee-8451-2f86991633da" status: 200 len: 1314 microversion: 2.1 time: 0.157888 Aug 27 04:47:23.999899 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 729/1463] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:47:23 2021] GET /compute/v2.1/servers/c74e9509-ca7f-47ee-8451-2f86991633da => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:25.015275 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-c1a2c5f3-4878-400e-b54c-3be9d84cc40d tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:25.015876 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-c1a2c5f3-4878-400e-b54c-3be9d84cc40d tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] [instance: c74e9509-ca7f-47ee-8451-2f86991633da] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:47:25.021922 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c1a2c5f3-4878-400e-b54c-3be9d84cc40d tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:25.022375 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c1a2c5f3-4878-400e-b54c-3be9d84cc40d tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:25.023157 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c1a2c5f3-4878-400e-b54c-3be9d84cc40d tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:25.023600 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-c1a2c5f3-4878-400e-b54c-3be9d84cc40d tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:25.153798 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-c1a2c5f3-4878-400e-b54c-3be9d84cc40d tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b3d65ce88a4ce7a7c06d30581996b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7521afb8ad9443b7b3c079e0b31051ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:25.161296 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-c1a2c5f3-4878-400e-b54c-3be9d84cc40d tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] 10.222.0.53 "GET /compute/v2.1/servers/c74e9509-ca7f-47ee-8451-2f86991633da" status: 200 len: 1314 microversion: 2.1 time: 0.149680 Aug 27 04:47:25.162527 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 735/1464] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:47:25 2021] GET /compute/v2.1/servers/c74e9509-ca7f-47ee-8451-2f86991633da => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:26.179774 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-22d52d3c-f3fe-4b41-97ce-534597e4290e tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:26.180421 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-22d52d3c-f3fe-4b41-97ce-534597e4290e tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] [instance: c74e9509-ca7f-47ee-8451-2f86991633da] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:47:26.186856 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-22d52d3c-f3fe-4b41-97ce-534597e4290e tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:26.187313 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-22d52d3c-f3fe-4b41-97ce-534597e4290e tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:26.188139 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-22d52d3c-f3fe-4b41-97ce-534597e4290e tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:26.188581 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-22d52d3c-f3fe-4b41-97ce-534597e4290e tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:26.321109 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-22d52d3c-f3fe-4b41-97ce-534597e4290e tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b3d65ce88a4ce7a7c06d30581996b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7521afb8ad9443b7b3c079e0b31051ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:26.328844 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-22d52d3c-f3fe-4b41-97ce-534597e4290e tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] 10.222.0.53 "GET /compute/v2.1/servers/c74e9509-ca7f-47ee-8451-2f86991633da" status: 200 len: 1314 microversion: 2.1 time: 0.153001 Aug 27 04:47:26.329649 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 730/1465] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:47:26 2021] GET /compute/v2.1/servers/c74e9509-ca7f-47ee-8451-2f86991633da => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:27.346276 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-78428951-d573-4af1-9da0-cf82b23b2c83 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:27.346888 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-78428951-d573-4af1-9da0-cf82b23b2c83 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] [instance: c74e9509-ca7f-47ee-8451-2f86991633da] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:47:27.353530 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-78428951-d573-4af1-9da0-cf82b23b2c83 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:27.353968 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-78428951-d573-4af1-9da0-cf82b23b2c83 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:27.354743 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-78428951-d573-4af1-9da0-cf82b23b2c83 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:27.355169 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-78428951-d573-4af1-9da0-cf82b23b2c83 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:27.487067 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-78428951-d573-4af1-9da0-cf82b23b2c83 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b3d65ce88a4ce7a7c06d30581996b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7521afb8ad9443b7b3c079e0b31051ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:27.494676 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-78428951-d573-4af1-9da0-cf82b23b2c83 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] 10.222.0.53 "GET /compute/v2.1/servers/c74e9509-ca7f-47ee-8451-2f86991633da" status: 200 len: 1314 microversion: 2.1 time: 0.152078 Aug 27 04:47:27.495258 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 736/1466] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:47:27 2021] GET /compute/v2.1/servers/c74e9509-ca7f-47ee-8451-2f86991633da => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:27.866175 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [req-734e83f1-772b-4849-ad4c-021c80059e22 req-7dafd800-04f0-4b08-a5eb-f85505ae5dd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c74e9509-ca7f-47ee-8451-2f86991633da", "name": "network-vif-plugged", "status": "completed", "tag": "d471ea0f-bc2f-4abf-8816-365135714c4a"}]} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:47:27.867920 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:47:27.867920 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: warnings.warn(msg) Aug 27 04:47:27.877103 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-734e83f1-772b-4849-ad4c-021c80059e22 req-7dafd800-04f0-4b08-a5eb-f85505ae5dd7 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:27.877567 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-734e83f1-772b-4849-ad4c-021c80059e22 req-7dafd800-04f0-4b08-a5eb-f85505ae5dd7 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:27.890360 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.compute.server_external_events [req-734e83f1-772b-4849-ad4c-021c80059e22 req-7dafd800-04f0-4b08-a5eb-f85505ae5dd7 service nova] Creating event network-vif-plugged:d471ea0f-bc2f-4abf-8816-365135714c4a for instance c74e9509-ca7f-47ee-8451-2f86991633da on hv-cinder-80403 Aug 27 04:47:27.895368 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [req-734e83f1-772b-4849-ad4c-021c80059e22 req-7dafd800-04f0-4b08-a5eb-f85505ae5dd7 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033534 Aug 27 04:47:27.896708 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 731/1467] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:47:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:47:28.512425 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-7d9830c1-715a-44d1-bdf5-015c8ee3ff28 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:28.513278 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-7d9830c1-715a-44d1-bdf5-015c8ee3ff28 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] [instance: c74e9509-ca7f-47ee-8451-2f86991633da] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:47:28.519246 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7d9830c1-715a-44d1-bdf5-015c8ee3ff28 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:28.519720 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7d9830c1-715a-44d1-bdf5-015c8ee3ff28 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:28.520516 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7d9830c1-715a-44d1-bdf5-015c8ee3ff28 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:28.521541 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-7d9830c1-715a-44d1-bdf5-015c8ee3ff28 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:28.649784 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-7d9830c1-715a-44d1-bdf5-015c8ee3ff28 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b3d65ce88a4ce7a7c06d30581996b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7521afb8ad9443b7b3c079e0b31051ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:28.657528 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-7d9830c1-715a-44d1-bdf5-015c8ee3ff28 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] 10.222.0.53 "GET /compute/v2.1/servers/c74e9509-ca7f-47ee-8451-2f86991633da" status: 200 len: 1314 microversion: 2.1 time: 0.148967 Aug 27 04:47:28.658102 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 737/1468] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:47:28 2021] GET /compute/v2.1/servers/c74e9509-ca7f-47ee-8451-2f86991633da => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:47:29.674558 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-9ad3c4f4-d230-416a-913b-e527833ab59c tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:29.675252 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-9ad3c4f4-d230-416a-913b-e527833ab59c tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] [instance: c74e9509-ca7f-47ee-8451-2f86991633da] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:47:29.682367 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9ad3c4f4-d230-416a-913b-e527833ab59c tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:29.682823 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9ad3c4f4-d230-416a-913b-e527833ab59c tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:29.683611 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9ad3c4f4-d230-416a-913b-e527833ab59c tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:29.684085 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9ad3c4f4-d230-416a-913b-e527833ab59c tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:29.855382 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-9ad3c4f4-d230-416a-913b-e527833ab59c tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b3d65ce88a4ce7a7c06d30581996b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7521afb8ad9443b7b3c079e0b31051ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:29.862771 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-9ad3c4f4-d230-416a-913b-e527833ab59c tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] 10.222.0.53 "GET /compute/v2.1/servers/c74e9509-ca7f-47ee-8451-2f86991633da" status: 200 len: 1314 microversion: 2.1 time: 0.192249 Aug 27 04:47:29.863333 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 732/1469] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:47:29 2021] GET /compute/v2.1/servers/c74e9509-ca7f-47ee-8451-2f86991633da => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:30.880252 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-a44f0719-c187-4ebb-8155-1dd3a336305e tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:30.880985 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-a44f0719-c187-4ebb-8155-1dd3a336305e tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] [instance: c74e9509-ca7f-47ee-8451-2f86991633da] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:47:30.887123 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a44f0719-c187-4ebb-8155-1dd3a336305e tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:30.887576 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a44f0719-c187-4ebb-8155-1dd3a336305e tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:30.888384 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a44f0719-c187-4ebb-8155-1dd3a336305e tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:30.888825 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a44f0719-c187-4ebb-8155-1dd3a336305e tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:31.019493 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-a44f0719-c187-4ebb-8155-1dd3a336305e tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b3d65ce88a4ce7a7c06d30581996b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7521afb8ad9443b7b3c079e0b31051ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:31.027492 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-a44f0719-c187-4ebb-8155-1dd3a336305e tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] 10.222.0.53 "GET /compute/v2.1/servers/c74e9509-ca7f-47ee-8451-2f86991633da" status: 200 len: 1497 microversion: 2.1 time: 0.150959 Aug 27 04:47:31.028092 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 738/1470] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:47:30 2021] GET /compute/v2.1/servers/c74e9509-ca7f-47ee-8451-2f86991633da => generated 1497 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:31.593978 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-7e821059-4bb2-4b54-9a69-0bf29b17fb11 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:31.594568 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-7e821059-4bb2-4b54-9a69-0bf29b17fb11 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] [instance: c74e9509-ca7f-47ee-8451-2f86991633da] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:47:31.600978 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7e821059-4bb2-4b54-9a69-0bf29b17fb11 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:31.601421 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7e821059-4bb2-4b54-9a69-0bf29b17fb11 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:31.602187 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7e821059-4bb2-4b54-9a69-0bf29b17fb11 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:31.602614 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-7e821059-4bb2-4b54-9a69-0bf29b17fb11 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:31.628542 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-7e821059-4bb2-4b54-9a69-0bf29b17fb11 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] [instance: c74e9509-ca7f-47ee-8451-2f86991633da] Going to try to terminate instance {{(pid=108970) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 04:47:31.713615 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-7e821059-4bb2-4b54-9a69-0bf29b17fb11 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] 10.222.0.53 "DELETE /compute/v2.1/servers/c74e9509-ca7f-47ee-8451-2f86991633da" status: 204 len: 0 microversion: 2.1 time: 0.122574 Aug 27 04:47:31.714558 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 733/1471] 10.222.0.53 () {58 vars in 1239 bytes} [Fri Aug 27 04:47:31 2021] DELETE /compute/v2.1/servers/c74e9509-ca7f-47ee-8451-2f86991633da => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:47:31.723380 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-85297f4c-f60d-48c8-b9a8-8d5281178449 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:31.724614 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-85297f4c-f60d-48c8-b9a8-8d5281178449 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] [instance: c74e9509-ca7f-47ee-8451-2f86991633da] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:47:31.731088 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-85297f4c-f60d-48c8-b9a8-8d5281178449 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:31.731528 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-85297f4c-f60d-48c8-b9a8-8d5281178449 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:31.732324 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-85297f4c-f60d-48c8-b9a8-8d5281178449 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:31.732782 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-85297f4c-f60d-48c8-b9a8-8d5281178449 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:31.863065 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-85297f4c-f60d-48c8-b9a8-8d5281178449 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b3d65ce88a4ce7a7c06d30581996b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7521afb8ad9443b7b3c079e0b31051ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:31.870700 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-85297f4c-f60d-48c8-b9a8-8d5281178449 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] 10.222.0.53 "GET /compute/v2.1/servers/c74e9509-ca7f-47ee-8451-2f86991633da" status: 200 len: 1503 microversion: 2.1 time: 0.151059 Aug 27 04:47:31.871287 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 739/1472] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:47:31 2021] GET /compute/v2.1/servers/c74e9509-ca7f-47ee-8451-2f86991633da => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:47:32.888980 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-01f6a5d2-b8eb-4479-8924-a23df9cd7c66 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:32.889675 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-01f6a5d2-b8eb-4479-8924-a23df9cd7c66 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] [instance: c74e9509-ca7f-47ee-8451-2f86991633da] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:47:32.895699 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-01f6a5d2-b8eb-4479-8924-a23df9cd7c66 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:32.896189 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-01f6a5d2-b8eb-4479-8924-a23df9cd7c66 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:32.896967 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-01f6a5d2-b8eb-4479-8924-a23df9cd7c66 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:32.897397 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-01f6a5d2-b8eb-4479-8924-a23df9cd7c66 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:33.030400 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-01f6a5d2-b8eb-4479-8924-a23df9cd7c66 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b3d65ce88a4ce7a7c06d30581996b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7521afb8ad9443b7b3c079e0b31051ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:33.038599 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-01f6a5d2-b8eb-4479-8924-a23df9cd7c66 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] 10.222.0.53 "GET /compute/v2.1/servers/c74e9509-ca7f-47ee-8451-2f86991633da" status: 200 len: 1503 microversion: 2.1 time: 0.153627 Aug 27 04:47:33.039195 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 734/1473] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:47:32 2021] GET /compute/v2.1/servers/c74e9509-ca7f-47ee-8451-2f86991633da => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:47:34.039311 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [req-219b4254-4897-42a5-8d64-b0124826c068 req-a996d494-6806-4a22-ac4a-05929f14a9ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c74e9509-ca7f-47ee-8451-2f86991633da", "name": "network-vif-deleted", "tag": "d471ea0f-bc2f-4abf-8816-365135714c4a"}]} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:47:34.040922 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:47:34.040922 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: warnings.warn(msg) Aug 27 04:47:34.049082 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-219b4254-4897-42a5-8d64-b0124826c068 req-a996d494-6806-4a22-ac4a-05929f14a9ad service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:34.049524 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-219b4254-4897-42a5-8d64-b0124826c068 req-a996d494-6806-4a22-ac4a-05929f14a9ad service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:34.055896 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-86a55434-3d1c-4628-a389-f131ae4c4311 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:34.056691 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-86a55434-3d1c-4628-a389-f131ae4c4311 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] [instance: c74e9509-ca7f-47ee-8451-2f86991633da] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:47:34.062737 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.compute.server_external_events [req-219b4254-4897-42a5-8d64-b0124826c068 req-a996d494-6806-4a22-ac4a-05929f14a9ad service nova] Creating event network-vif-deleted:d471ea0f-bc2f-4abf-8816-365135714c4a for instance c74e9509-ca7f-47ee-8451-2f86991633da on hv-cinder-80403 Aug 27 04:47:34.068413 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [req-219b4254-4897-42a5-8d64-b0124826c068 req-a996d494-6806-4a22-ac4a-05929f14a9ad service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032156 Aug 27 04:47:34.069030 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 740/1474] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:47:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:47:34.071163 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-86a55434-3d1c-4628-a389-f131ae4c4311 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:34.071780 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-86a55434-3d1c-4628-a389-f131ae4c4311 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:34.072819 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-86a55434-3d1c-4628-a389-f131ae4c4311 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:34.073262 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-86a55434-3d1c-4628-a389-f131ae4c4311 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:34.143129 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-86a55434-3d1c-4628-a389-f131ae4c4311 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b3d65ce88a4ce7a7c06d30581996b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7521afb8ad9443b7b3c079e0b31051ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:47:34.155191 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-86a55434-3d1c-4628-a389-f131ae4c4311 tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] 10.222.0.53 "GET /compute/v2.1/servers/c74e9509-ca7f-47ee-8451-2f86991633da" status: 200 len: 1299 microversion: 2.1 time: 0.103159 Aug 27 04:47:34.156338 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 735/1475] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:47:34 2021] GET /compute/v2.1/servers/c74e9509-ca7f-47ee-8451-2f86991633da => generated 1299 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:47:35.177540 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-bbc9d447-b271-405f-83af-caf42d2f3cdc tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:47:35.178678 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-bbc9d447-b271-405f-83af-caf42d2f3cdc tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] [instance: c74e9509-ca7f-47ee-8451-2f86991633da] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:47:35.186752 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-bbc9d447-b271-405f-83af-caf42d2f3cdc tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:35.187193 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-bbc9d447-b271-405f-83af-caf42d2f3cdc tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:35.187959 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-bbc9d447-b271-405f-83af-caf42d2f3cdc tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:47:35.188417 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-bbc9d447-b271-405f-83af-caf42d2f3cdc tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:47:35.206555 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.wsgi [None req-bbc9d447-b271-405f-83af-caf42d2f3cdc tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] HTTP exception thrown: Instance c74e9509-ca7f-47ee-8451-2f86991633da could not be found. Aug 27 04:47:35.207141 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-bbc9d447-b271-405f-83af-caf42d2f3cdc tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] Returning 404 to user: Instance c74e9509-ca7f-47ee-8451-2f86991633da could not be found. {{(pid=108971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:47:35.207969 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-bbc9d447-b271-405f-83af-caf42d2f3cdc tempest-VolumesActionsTest-688963094 tempest-VolumesActionsTest-688963094-project] 10.222.0.53 "GET /compute/v2.1/servers/c74e9509-ca7f-47ee-8451-2f86991633da" status: 404 len: 111 microversion: 2.1 time: 0.038347 Aug 27 04:47:35.208717 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 741/1476] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:47:35 2021] GET /compute/v2.1/servers/c74e9509-ca7f-47ee-8451-2f86991633da => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:48:19.325507 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:48:19.326239 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: Fri Aug 27 04:48:19 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:48:47.244042 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dae29848-fd8d-49a8-9138-77fd52175e15] AMQP server on 10.222.0.53:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:48:47.247711 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-951fac5a-a0e6-426d-9920-68239625d19f tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:47.248250 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-951fac5a-a0e6-426d-9920-68239625d19f tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 0e1ad5f4-a543-4d5f-bfcc-521717d219f7] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:48:47.254806 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-951fac5a-a0e6-426d-9920-68239625d19f tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:48:47.255269 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-951fac5a-a0e6-426d-9920-68239625d19f tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:48:47.256071 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-951fac5a-a0e6-426d-9920-68239625d19f tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:48:47.256517 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-951fac5a-a0e6-426d-9920-68239625d19f tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:48:47.280553 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-951fac5a-a0e6-426d-9920-68239625d19f tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 0e1ad5f4-a543-4d5f-bfcc-521717d219f7] Going to try to terminate instance {{(pid=108970) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 04:48:47.361464 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-951fac5a-a0e6-426d-9920-68239625d19f tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "DELETE /compute/v2.1/servers/0e1ad5f4-a543-4d5f-bfcc-521717d219f7" status: 204 len: 0 microversion: 2.1 time: 0.118648 Aug 27 04:48:47.365871 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 736/1477] 10.222.0.53 () {58 vars in 1239 bytes} [Fri Aug 27 04:48:47 2021] DELETE /compute/v2.1/servers/0e1ad5f4-a543-4d5f-bfcc-521717d219f7 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 04:48:47.371609 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-75c2ca5a-90e9-4a3e-8582-63d961222226 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:47.372261 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-75c2ca5a-90e9-4a3e-8582-63d961222226 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 0e1ad5f4-a543-4d5f-bfcc-521717d219f7] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:48:47.378272 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-75c2ca5a-90e9-4a3e-8582-63d961222226 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:48:47.378727 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-75c2ca5a-90e9-4a3e-8582-63d961222226 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:48:47.380047 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-75c2ca5a-90e9-4a3e-8582-63d961222226 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:48:47.380487 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-75c2ca5a-90e9-4a3e-8582-63d961222226 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:48:47.504852 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-75c2ca5a-90e9-4a3e-8582-63d961222226 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5af28c28d4044fe8b57978dd4b775e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268453b6c33d4cc0a6486da778b00f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:47.512142 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-75c2ca5a-90e9-4a3e-8582-63d961222226 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/0e1ad5f4-a543-4d5f-bfcc-521717d219f7" status: 200 len: 1576 microversion: 2.1 time: 0.145142 Aug 27 04:48:47.512702 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 742/1478] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:48:47 2021] GET /compute/v2.1/servers/0e1ad5f4-a543-4d5f-bfcc-521717d219f7 => generated 1576 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:48.530560 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-688359c3-8863-4c36-8fc6-a432f8897112 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:48.531265 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-688359c3-8863-4c36-8fc6-a432f8897112 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 0e1ad5f4-a543-4d5f-bfcc-521717d219f7] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:48:48.549000 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-688359c3-8863-4c36-8fc6-a432f8897112 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:48:48.549448 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-688359c3-8863-4c36-8fc6-a432f8897112 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:48:48.550235 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-688359c3-8863-4c36-8fc6-a432f8897112 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:48:48.550676 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-688359c3-8863-4c36-8fc6-a432f8897112 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:48:48.556659 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO oslo.messaging._drivers.impl_rabbit [-] [dae29848-fd8d-49a8-9138-77fd52175e15] Reconnected to AMQP server on 10.222.0.53:5672 via [amqp] client with port 47806. Aug 27 04:48:48.674588 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-688359c3-8863-4c36-8fc6-a432f8897112 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5af28c28d4044fe8b57978dd4b775e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268453b6c33d4cc0a6486da778b00f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:48.682639 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-688359c3-8863-4c36-8fc6-a432f8897112 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/0e1ad5f4-a543-4d5f-bfcc-521717d219f7" status: 200 len: 1576 microversion: 2.1 time: 0.156073 Aug 27 04:48:48.683235 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 737/1479] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:48:48 2021] GET /compute/v2.1/servers/0e1ad5f4-a543-4d5f-bfcc-521717d219f7 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:49.699947 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-297eae50-619a-4e83-ae31-a9b6586fd99e tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:49.700565 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-297eae50-619a-4e83-ae31-a9b6586fd99e tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 0e1ad5f4-a543-4d5f-bfcc-521717d219f7] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:48:49.706675 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-297eae50-619a-4e83-ae31-a9b6586fd99e tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:48:49.707124 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-297eae50-619a-4e83-ae31-a9b6586fd99e tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:48:49.707923 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-297eae50-619a-4e83-ae31-a9b6586fd99e tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:48:49.708992 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-297eae50-619a-4e83-ae31-a9b6586fd99e tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:48:49.829376 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-297eae50-619a-4e83-ae31-a9b6586fd99e tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5af28c28d4044fe8b57978dd4b775e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268453b6c33d4cc0a6486da778b00f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:49.837580 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-297eae50-619a-4e83-ae31-a9b6586fd99e tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/0e1ad5f4-a543-4d5f-bfcc-521717d219f7" status: 200 len: 1576 microversion: 2.1 time: 0.141477 Aug 27 04:48:49.838147 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 743/1480] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:48:49 2021] GET /compute/v2.1/servers/0e1ad5f4-a543-4d5f-bfcc-521717d219f7 => generated 1576 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:50.241838 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [req-f5cde3f8-6582-4d85-8bc0-ecf45d02d411 req-2de00890-ab1d-43d1-a273-0405958134fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e1ad5f4-a543-4d5f-bfcc-521717d219f7", "name": "network-vif-deleted", "tag": "2f4fdbaf-69a6-4d05-be39-30fa63e09ed7"}]} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:48:50.244120 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:48:50.244120 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: warnings.warn(msg) Aug 27 04:48:50.257537 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-f5cde3f8-6582-4d85-8bc0-ecf45d02d411 req-2de00890-ab1d-43d1-a273-0405958134fe service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:48:50.257964 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-f5cde3f8-6582-4d85-8bc0-ecf45d02d411 req-2de00890-ab1d-43d1-a273-0405958134fe service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:48:50.269855 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.compute.server_external_events [req-f5cde3f8-6582-4d85-8bc0-ecf45d02d411 req-2de00890-ab1d-43d1-a273-0405958134fe service nova] Creating event network-vif-deleted:2f4fdbaf-69a6-4d05-be39-30fa63e09ed7 for instance 0e1ad5f4-a543-4d5f-bfcc-521717d219f7 on hv-cinder-80403 Aug 27 04:48:50.277043 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [req-f5cde3f8-6582-4d85-8bc0-ecf45d02d411 req-2de00890-ab1d-43d1-a273-0405958134fe service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038747 Aug 27 04:48:50.277871 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 738/1481] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:48:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:48:50.854710 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-8a5fc420-37fe-4dc4-940c-4220c7670761 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:50.855318 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-8a5fc420-37fe-4dc4-940c-4220c7670761 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 0e1ad5f4-a543-4d5f-bfcc-521717d219f7] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:48:50.861263 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8a5fc420-37fe-4dc4-940c-4220c7670761 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:48:50.861705 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8a5fc420-37fe-4dc4-940c-4220c7670761 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:48:50.862477 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8a5fc420-37fe-4dc4-940c-4220c7670761 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:48:50.862908 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8a5fc420-37fe-4dc4-940c-4220c7670761 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:48:50.894510 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8a5fc420-37fe-4dc4-940c-4220c7670761 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:48:50.894950 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-8a5fc420-37fe-4dc4-940c-4220c7670761 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:48:50.895413 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.objects.instance [None req-8a5fc420-37fe-4dc4-940c-4220c7670761 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lazy-loading 'fault' on Instance uuid 0e1ad5f4-a543-4d5f-bfcc-521717d219f7 {{(pid=108971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:48:50.937003 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-8a5fc420-37fe-4dc4-940c-4220c7670761 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5af28c28d4044fe8b57978dd4b775e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268453b6c33d4cc0a6486da778b00f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:50.949755 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-8a5fc420-37fe-4dc4-940c-4220c7670761 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/0e1ad5f4-a543-4d5f-bfcc-521717d219f7" status: 200 len: 1230 microversion: 2.1 time: 0.098620 Aug 27 04:48:50.950643 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 744/1482] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:48:50 2021] GET /compute/v2.1/servers/0e1ad5f4-a543-4d5f-bfcc-521717d219f7 => generated 1230 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:51.968046 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-29185147-1bcf-4590-ba65-1220156df575 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:51.968740 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-29185147-1bcf-4590-ba65-1220156df575 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 0e1ad5f4-a543-4d5f-bfcc-521717d219f7] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:48:51.975368 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-29185147-1bcf-4590-ba65-1220156df575 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:48:51.975814 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-29185147-1bcf-4590-ba65-1220156df575 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:48:51.976605 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-29185147-1bcf-4590-ba65-1220156df575 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:48:51.977291 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-29185147-1bcf-4590-ba65-1220156df575 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:48:51.990828 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.wsgi [None req-29185147-1bcf-4590-ba65-1220156df575 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] HTTP exception thrown: Instance 0e1ad5f4-a543-4d5f-bfcc-521717d219f7 could not be found. Aug 27 04:48:51.991409 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-29185147-1bcf-4590-ba65-1220156df575 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Returning 404 to user: Instance 0e1ad5f4-a543-4d5f-bfcc-521717d219f7 could not be found. {{(pid=108970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:48:51.992279 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-29185147-1bcf-4590-ba65-1220156df575 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/0e1ad5f4-a543-4d5f-bfcc-521717d219f7" status: 404 len: 111 microversion: 2.1 time: 0.028352 Aug 27 04:48:51.992823 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 739/1483] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:48:51 2021] GET /compute/v2.1/servers/0e1ad5f4-a543-4d5f-bfcc-521717d219f7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:48:52.153600 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-b70802f7-dbd1-4335-9c4f-66560d04d331 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1788797883", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-725197301", "security_groups": [{"name": "tempest-secgroup-smoke-440466660"}], "block_device_mapping_v2": [{"uuid": "868dd495-03dd-4a05-82f0-5872fef891c9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1818e3b3-3df5-4098-8cd9-7e007e79848c"}]}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:48:52.257438 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.network.neutron [None req-b70802f7-dbd1-4335-9c4f-66560d04d331 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] validate_networks() for [('1818e3b3-3df5-4098-8cd9-7e007e79848c', None, None, None, None, None)] {{(pid=108971) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 04:48:52.629613 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.virt.hardware [None req-b70802f7-dbd1-4335-9c4f-66560d04d331 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Flavor limits 0:0:0 {{(pid=108971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:48:52.630555 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.virt.hardware [None req-b70802f7-dbd1-4335-9c4f-66560d04d331 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Image limits 0:0:0 {{(pid=108971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:48:52.631048 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.virt.hardware [None req-b70802f7-dbd1-4335-9c4f-66560d04d331 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Flavor pref 0:0:0 {{(pid=108971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:48:52.631418 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.virt.hardware [None req-b70802f7-dbd1-4335-9c4f-66560d04d331 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Image pref 0:0:0 {{(pid=108971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:48:52.631816 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.virt.hardware [None req-b70802f7-dbd1-4335-9c4f-66560d04d331 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:48:52.640449 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b70802f7-dbd1-4335-9c4f-66560d04d331 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:48:52.640884 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b70802f7-dbd1-4335-9c4f-66560d04d331 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:48:52.641672 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b70802f7-dbd1-4335-9c4f-66560d04d331 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:48:52.642100 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b70802f7-dbd1-4335-9c4f-66560d04d331 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:48:52.659249 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.quota [None req-b70802f7-dbd1-4335-9c4f-66560d04d331 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Getting quotas for project 268453b6c33d4cc0a6486da778b00f9b. Resources: {'ram', 'cores', 'instances'} {{(pid=108971) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:48:52.663131 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.quota [None req-b70802f7-dbd1-4335-9c4f-66560d04d331 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Getting quotas for user c5af28c28d4044fe8b57978dd4b775e3 and project 268453b6c33d4cc0a6486da778b00f9b. Resources: {'ram', 'cores', 'instances'} {{(pid=108971) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:48:52.722384 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-b70802f7-dbd1-4335-9c4f-66560d04d331 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Going to run 1 instances... {{(pid=108971) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 04:48:52.725171 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-b70802f7-dbd1-4335-9c4f-66560d04d331 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 1d185186-1575-4963-91f6-9f35533b06fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='868dd495-03dd-4a05-82f0-5872fef891c9',volume_size=None,volume_type=None)] {{(pid=108971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 04:48:52.843898 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-b70802f7-dbd1-4335-9c4f-66560d04d331 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.693986 Aug 27 04:48:52.844577 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 745/1484] 10.222.0.53 () {60 vars in 1147 bytes} [Fri Aug 27 04:48:52 2021] POST /compute/v2.1/servers => generated 405 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:48:52.855048 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-ff792bff-db20-4e2c-ae1f-cbe2941a3cdb tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:52.855687 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-ff792bff-db20-4e2c-ae1f-cbe2941a3cdb tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 1d185186-1575-4963-91f6-9f35533b06fa] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:48:52.910886 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-ff792bff-db20-4e2c-ae1f-cbe2941a3cdb tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5af28c28d4044fe8b57978dd4b775e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268453b6c33d4cc0a6486da778b00f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:52.917962 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-ff792bff-db20-4e2c-ae1f-cbe2941a3cdb tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/1d185186-1575-4963-91f6-9f35533b06fa" status: 200 len: 1094 microversion: 2.1 time: 0.066862 Aug 27 04:48:52.918529 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 740/1485] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:48:52 2021] GET /compute/v2.1/servers/1d185186-1575-4963-91f6-9f35533b06fa => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:53.935894 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-984599ca-db5d-4ad3-9088-773ca4928cac tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:53.936695 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-984599ca-db5d-4ad3-9088-773ca4928cac tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 1d185186-1575-4963-91f6-9f35533b06fa] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:48:53.943445 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-984599ca-db5d-4ad3-9088-773ca4928cac tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:48:53.943931 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-984599ca-db5d-4ad3-9088-773ca4928cac tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:48:53.944905 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-984599ca-db5d-4ad3-9088-773ca4928cac tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:48:53.945339 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-984599ca-db5d-4ad3-9088-773ca4928cac tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:48:54.008037 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-984599ca-db5d-4ad3-9088-773ca4928cac tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5af28c28d4044fe8b57978dd4b775e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268453b6c33d4cc0a6486da778b00f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:54.015346 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-984599ca-db5d-4ad3-9088-773ca4928cac tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/1d185186-1575-4963-91f6-9f35533b06fa" status: 200 len: 1210 microversion: 2.1 time: 0.084444 Aug 27 04:48:54.016096 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 746/1486] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:48:53 2021] GET /compute/v2.1/servers/1d185186-1575-4963-91f6-9f35533b06fa => generated 1210 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:55.032213 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-e4604234-a65d-461b-b894-afef1bf79491 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:55.032831 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-e4604234-a65d-461b-b894-afef1bf79491 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 1d185186-1575-4963-91f6-9f35533b06fa] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:48:55.047467 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e4604234-a65d-461b-b894-afef1bf79491 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:48:55.047905 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e4604234-a65d-461b-b894-afef1bf79491 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:48:55.048720 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e4604234-a65d-461b-b894-afef1bf79491 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:48:55.049745 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e4604234-a65d-461b-b894-afef1bf79491 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:48:55.251502 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-e4604234-a65d-461b-b894-afef1bf79491 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5af28c28d4044fe8b57978dd4b775e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268453b6c33d4cc0a6486da778b00f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:55.260270 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-e4604234-a65d-461b-b894-afef1bf79491 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/1d185186-1575-4963-91f6-9f35533b06fa" status: 200 len: 1265 microversion: 2.1 time: 0.231571 Aug 27 04:48:55.260841 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 741/1487] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:48:55 2021] GET /compute/v2.1/servers/1d185186-1575-4963-91f6-9f35533b06fa => generated 1265 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:55.333196 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [req-e6bde139-fca1-4895-80a3-59732f07d73d req-354ded3e-6a69-47d4-94da-974dac1ef2c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d185186-1575-4963-91f6-9f35533b06fa", "tag": "4b35c1d5-7c3f-461b-b444-c493c38fa554"}]} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:48:55.334795 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:48:55.334795 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: warnings.warn(msg) Aug 27 04:48:55.341879 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-e6bde139-fca1-4895-80a3-59732f07d73d req-354ded3e-6a69-47d4-94da-974dac1ef2c9 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:48:55.342524 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-e6bde139-fca1-4895-80a3-59732f07d73d req-354ded3e-6a69-47d4-94da-974dac1ef2c9 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:48:55.359487 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.compute.server_external_events [req-e6bde139-fca1-4895-80a3-59732f07d73d req-354ded3e-6a69-47d4-94da-974dac1ef2c9 service nova] Creating event network-changed:4b35c1d5-7c3f-461b-b444-c493c38fa554 for instance 1d185186-1575-4963-91f6-9f35533b06fa on hv-cinder-80403 Aug 27 04:48:55.375114 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [req-e6bde139-fca1-4895-80a3-59732f07d73d req-354ded3e-6a69-47d4-94da-974dac1ef2c9 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044780 Aug 27 04:48:55.375750 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 747/1488] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:48:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:48:56.277656 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-f863a273-57bc-4906-a488-9b473f02072f tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:56.278271 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-f863a273-57bc-4906-a488-9b473f02072f tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 1d185186-1575-4963-91f6-9f35533b06fa] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:48:56.284654 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f863a273-57bc-4906-a488-9b473f02072f tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:48:56.285301 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f863a273-57bc-4906-a488-9b473f02072f tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:48:56.286662 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f863a273-57bc-4906-a488-9b473f02072f tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:48:56.287212 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f863a273-57bc-4906-a488-9b473f02072f tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:48:56.430845 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-f863a273-57bc-4906-a488-9b473f02072f tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5af28c28d4044fe8b57978dd4b775e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268453b6c33d4cc0a6486da778b00f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:56.438258 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-f863a273-57bc-4906-a488-9b473f02072f tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/1d185186-1575-4963-91f6-9f35533b06fa" status: 200 len: 1265 microversion: 2.1 time: 0.164392 Aug 27 04:48:56.438832 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 742/1489] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:48:56 2021] GET /compute/v2.1/servers/1d185186-1575-4963-91f6-9f35533b06fa => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:57.456368 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-834c393d-4970-424a-ba6f-53feea7efd9d tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:57.457061 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-834c393d-4970-424a-ba6f-53feea7efd9d tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 1d185186-1575-4963-91f6-9f35533b06fa] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:48:57.463914 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-834c393d-4970-424a-ba6f-53feea7efd9d tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:48:57.464402 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-834c393d-4970-424a-ba6f-53feea7efd9d tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:48:57.465172 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-834c393d-4970-424a-ba6f-53feea7efd9d tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:48:57.465616 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-834c393d-4970-424a-ba6f-53feea7efd9d tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:48:57.595648 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-834c393d-4970-424a-ba6f-53feea7efd9d tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5af28c28d4044fe8b57978dd4b775e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268453b6c33d4cc0a6486da778b00f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:57.603899 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-834c393d-4970-424a-ba6f-53feea7efd9d tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/1d185186-1575-4963-91f6-9f35533b06fa" status: 200 len: 1265 microversion: 2.1 time: 0.151668 Aug 27 04:48:57.604509 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 748/1490] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:48:57 2021] GET /compute/v2.1/servers/1d185186-1575-4963-91f6-9f35533b06fa => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:58.620986 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-2b4d8506-1448-452c-8770-4ca7e4bc083f tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:58.621598 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-2b4d8506-1448-452c-8770-4ca7e4bc083f tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 1d185186-1575-4963-91f6-9f35533b06fa] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:48:58.627474 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2b4d8506-1448-452c-8770-4ca7e4bc083f tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:48:58.627926 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2b4d8506-1448-452c-8770-4ca7e4bc083f tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:48:58.628742 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2b4d8506-1448-452c-8770-4ca7e4bc083f tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:48:58.629184 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-2b4d8506-1448-452c-8770-4ca7e4bc083f tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:48:58.748663 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-2b4d8506-1448-452c-8770-4ca7e4bc083f tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5af28c28d4044fe8b57978dd4b775e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268453b6c33d4cc0a6486da778b00f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:58.756751 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-2b4d8506-1448-452c-8770-4ca7e4bc083f tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/1d185186-1575-4963-91f6-9f35533b06fa" status: 200 len: 1265 microversion: 2.1 time: 0.139437 Aug 27 04:48:58.757333 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 743/1491] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:48:58 2021] GET /compute/v2.1/servers/1d185186-1575-4963-91f6-9f35533b06fa => generated 1265 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:48:59.773617 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-6cc8ef9c-86ee-4262-a4fe-682bc680535a tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:48:59.774261 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-6cc8ef9c-86ee-4262-a4fe-682bc680535a tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 1d185186-1575-4963-91f6-9f35533b06fa] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:48:59.780208 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6cc8ef9c-86ee-4262-a4fe-682bc680535a tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:48:59.780662 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6cc8ef9c-86ee-4262-a4fe-682bc680535a tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:48:59.781427 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6cc8ef9c-86ee-4262-a4fe-682bc680535a tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:48:59.781867 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6cc8ef9c-86ee-4262-a4fe-682bc680535a tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:48:59.899951 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-6cc8ef9c-86ee-4262-a4fe-682bc680535a tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5af28c28d4044fe8b57978dd4b775e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268453b6c33d4cc0a6486da778b00f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:48:59.907279 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-6cc8ef9c-86ee-4262-a4fe-682bc680535a tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/1d185186-1575-4963-91f6-9f35533b06fa" status: 200 len: 1265 microversion: 2.1 time: 0.137456 Aug 27 04:48:59.907843 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 749/1492] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:48:59 2021] GET /compute/v2.1/servers/1d185186-1575-4963-91f6-9f35533b06fa => generated 1265 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:00.924248 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-0b2ae0f6-f5d8-4f4a-beba-921390f07cb8 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:00.924854 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-0b2ae0f6-f5d8-4f4a-beba-921390f07cb8 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 1d185186-1575-4963-91f6-9f35533b06fa] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:49:00.930952 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0b2ae0f6-f5d8-4f4a-beba-921390f07cb8 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:49:00.931411 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0b2ae0f6-f5d8-4f4a-beba-921390f07cb8 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:49:00.932229 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0b2ae0f6-f5d8-4f4a-beba-921390f07cb8 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:49:00.932679 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0b2ae0f6-f5d8-4f4a-beba-921390f07cb8 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:49:01.054851 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-0b2ae0f6-f5d8-4f4a-beba-921390f07cb8 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5af28c28d4044fe8b57978dd4b775e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268453b6c33d4cc0a6486da778b00f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:01.062104 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-0b2ae0f6-f5d8-4f4a-beba-921390f07cb8 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/1d185186-1575-4963-91f6-9f35533b06fa" status: 200 len: 1265 microversion: 2.1 time: 0.141500 Aug 27 04:49:01.062671 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 744/1493] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:49:00 2021] GET /compute/v2.1/servers/1d185186-1575-4963-91f6-9f35533b06fa => generated 1265 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:02.078425 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-9e9b1581-d6b4-4476-99fa-d3af4a502efd tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:02.079023 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-9e9b1581-d6b4-4476-99fa-d3af4a502efd tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 1d185186-1575-4963-91f6-9f35533b06fa] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:49:02.085578 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9e9b1581-d6b4-4476-99fa-d3af4a502efd tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:49:02.086030 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9e9b1581-d6b4-4476-99fa-d3af4a502efd tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:49:02.086802 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9e9b1581-d6b4-4476-99fa-d3af4a502efd tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:49:02.087243 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9e9b1581-d6b4-4476-99fa-d3af4a502efd tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:49:02.206013 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-9e9b1581-d6b4-4476-99fa-d3af4a502efd tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5af28c28d4044fe8b57978dd4b775e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268453b6c33d4cc0a6486da778b00f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:02.213896 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-9e9b1581-d6b4-4476-99fa-d3af4a502efd tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/1d185186-1575-4963-91f6-9f35533b06fa" status: 200 len: 1265 microversion: 2.1 time: 0.139135 Aug 27 04:49:02.214461 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 750/1494] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:49:02 2021] GET /compute/v2.1/servers/1d185186-1575-4963-91f6-9f35533b06fa => generated 1265 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:03.230491 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-66871d48-3156-48d0-bc23-fa4a85559c96 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:03.231110 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-66871d48-3156-48d0-bc23-fa4a85559c96 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 1d185186-1575-4963-91f6-9f35533b06fa] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:49:03.237086 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-66871d48-3156-48d0-bc23-fa4a85559c96 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:49:03.237543 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-66871d48-3156-48d0-bc23-fa4a85559c96 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:49:03.238319 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-66871d48-3156-48d0-bc23-fa4a85559c96 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:49:03.238764 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-66871d48-3156-48d0-bc23-fa4a85559c96 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:49:03.356578 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-66871d48-3156-48d0-bc23-fa4a85559c96 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5af28c28d4044fe8b57978dd4b775e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268453b6c33d4cc0a6486da778b00f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:03.363903 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-66871d48-3156-48d0-bc23-fa4a85559c96 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/1d185186-1575-4963-91f6-9f35533b06fa" status: 200 len: 1265 microversion: 2.1 time: 0.137350 Aug 27 04:49:03.365017 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 745/1495] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:49:03 2021] GET /compute/v2.1/servers/1d185186-1575-4963-91f6-9f35533b06fa => generated 1265 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:04.380724 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-839c2a2a-3c30-4bde-b309-6abb1434f05d tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:04.381330 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-839c2a2a-3c30-4bde-b309-6abb1434f05d tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 1d185186-1575-4963-91f6-9f35533b06fa] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:49:04.387848 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-839c2a2a-3c30-4bde-b309-6abb1434f05d tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:49:04.388324 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-839c2a2a-3c30-4bde-b309-6abb1434f05d tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:49:04.389084 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-839c2a2a-3c30-4bde-b309-6abb1434f05d tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:49:04.389512 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-839c2a2a-3c30-4bde-b309-6abb1434f05d tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:49:04.514543 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-839c2a2a-3c30-4bde-b309-6abb1434f05d tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5af28c28d4044fe8b57978dd4b775e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268453b6c33d4cc0a6486da778b00f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:04.522407 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-839c2a2a-3c30-4bde-b309-6abb1434f05d tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/1d185186-1575-4963-91f6-9f35533b06fa" status: 200 len: 1265 microversion: 2.1 time: 0.145356 Aug 27 04:49:04.522972 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 751/1496] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:49:04 2021] GET /compute/v2.1/servers/1d185186-1575-4963-91f6-9f35533b06fa => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:05.539358 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-50af7114-47e8-454c-a63b-223d20ff0931 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:05.539973 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-50af7114-47e8-454c-a63b-223d20ff0931 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 1d185186-1575-4963-91f6-9f35533b06fa] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:49:05.546057 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-50af7114-47e8-454c-a63b-223d20ff0931 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:49:05.546515 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-50af7114-47e8-454c-a63b-223d20ff0931 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:49:05.547292 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-50af7114-47e8-454c-a63b-223d20ff0931 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:49:05.547737 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-50af7114-47e8-454c-a63b-223d20ff0931 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:49:05.667848 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-50af7114-47e8-454c-a63b-223d20ff0931 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5af28c28d4044fe8b57978dd4b775e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268453b6c33d4cc0a6486da778b00f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:05.675079 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-50af7114-47e8-454c-a63b-223d20ff0931 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/1d185186-1575-4963-91f6-9f35533b06fa" status: 200 len: 1265 microversion: 2.1 time: 0.139470 Aug 27 04:49:05.675651 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 746/1497] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:49:05 2021] GET /compute/v2.1/servers/1d185186-1575-4963-91f6-9f35533b06fa => generated 1265 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:06.541912 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [req-518b3053-bd4a-4273-87e2-5cca56bd961d req-2cd5aae4-7237-42ea-8e6e-9ad161a73c4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d185186-1575-4963-91f6-9f35533b06fa", "name": "network-vif-plugged", "status": "completed", "tag": "4b35c1d5-7c3f-461b-b444-c493c38fa554"}]} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:49:06.543477 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:49:06.543477 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: warnings.warn(msg) Aug 27 04:49:06.550268 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-518b3053-bd4a-4273-87e2-5cca56bd961d req-2cd5aae4-7237-42ea-8e6e-9ad161a73c4b service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:49:06.550712 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-518b3053-bd4a-4273-87e2-5cca56bd961d req-2cd5aae4-7237-42ea-8e6e-9ad161a73c4b service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:49:06.561920 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.compute.server_external_events [req-518b3053-bd4a-4273-87e2-5cca56bd961d req-2cd5aae4-7237-42ea-8e6e-9ad161a73c4b service nova] Creating event network-vif-plugged:4b35c1d5-7c3f-461b-b444-c493c38fa554 for instance 1d185186-1575-4963-91f6-9f35533b06fa on hv-cinder-80403 Aug 27 04:49:06.567514 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [req-518b3053-bd4a-4273-87e2-5cca56bd961d req-2cd5aae4-7237-42ea-8e6e-9ad161a73c4b service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146249 Aug 27 04:49:06.568126 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 752/1498] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:49:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:49:06.693464 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-47233094-30ef-44fe-a749-b2312547e7be tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:06.694122 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-47233094-30ef-44fe-a749-b2312547e7be tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 1d185186-1575-4963-91f6-9f35533b06fa] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:49:06.699997 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-47233094-30ef-44fe-a749-b2312547e7be tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:49:06.700475 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-47233094-30ef-44fe-a749-b2312547e7be tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:49:06.701253 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-47233094-30ef-44fe-a749-b2312547e7be tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:49:06.701696 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-47233094-30ef-44fe-a749-b2312547e7be tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:49:06.873309 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-47233094-30ef-44fe-a749-b2312547e7be tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5af28c28d4044fe8b57978dd4b775e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268453b6c33d4cc0a6486da778b00f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:06.880798 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-47233094-30ef-44fe-a749-b2312547e7be tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/1d185186-1575-4963-91f6-9f35533b06fa" status: 200 len: 1265 microversion: 2.1 time: 0.192401 Aug 27 04:49:06.881368 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 747/1499] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:49:06 2021] GET /compute/v2.1/servers/1d185186-1575-4963-91f6-9f35533b06fa => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:07.898168 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-5ca929a4-537e-4d72-8adb-b5071bba3685 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:07.898867 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-5ca929a4-537e-4d72-8adb-b5071bba3685 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 1d185186-1575-4963-91f6-9f35533b06fa] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:49:07.905081 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5ca929a4-537e-4d72-8adb-b5071bba3685 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:49:07.905532 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5ca929a4-537e-4d72-8adb-b5071bba3685 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:49:07.906301 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5ca929a4-537e-4d72-8adb-b5071bba3685 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:49:07.906740 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-5ca929a4-537e-4d72-8adb-b5071bba3685 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:49:08.032895 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-5ca929a4-537e-4d72-8adb-b5071bba3685 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5af28c28d4044fe8b57978dd4b775e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268453b6c33d4cc0a6486da778b00f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:08.040885 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-5ca929a4-537e-4d72-8adb-b5071bba3685 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/1d185186-1575-4963-91f6-9f35533b06fa" status: 200 len: 1265 microversion: 2.1 time: 0.146749 Aug 27 04:49:08.041521 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 753/1500] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:49:07 2021] GET /compute/v2.1/servers/1d185186-1575-4963-91f6-9f35533b06fa => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:09.058271 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-e2055dea-2979-4e7d-b827-c66ba330b79a tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:09.058891 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-e2055dea-2979-4e7d-b827-c66ba330b79a tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 1d185186-1575-4963-91f6-9f35533b06fa] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:49:09.064826 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e2055dea-2979-4e7d-b827-c66ba330b79a tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:49:09.065291 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e2055dea-2979-4e7d-b827-c66ba330b79a tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:49:09.066064 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e2055dea-2979-4e7d-b827-c66ba330b79a tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:49:09.066512 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-e2055dea-2979-4e7d-b827-c66ba330b79a tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:49:09.187847 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-e2055dea-2979-4e7d-b827-c66ba330b79a tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5af28c28d4044fe8b57978dd4b775e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268453b6c33d4cc0a6486da778b00f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:09.195937 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-e2055dea-2979-4e7d-b827-c66ba330b79a tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/1d185186-1575-4963-91f6-9f35533b06fa" status: 200 len: 1451 microversion: 2.1 time: 0.141382 Aug 27 04:49:09.196530 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 748/1501] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:49:09 2021] GET /compute/v2.1/servers/1d185186-1575-4963-91f6-9f35533b06fa => generated 1451 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:09.213748 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-d851f1cf-1185-41fe-8e1a-c36659e43db6 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:49:09.214350 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-d851f1cf-1185-41fe-8e1a-c36659e43db6 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 1d185186-1575-4963-91f6-9f35533b06fa] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:49:09.220104 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d851f1cf-1185-41fe-8e1a-c36659e43db6 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:49:09.220556 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d851f1cf-1185-41fe-8e1a-c36659e43db6 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:49:09.221305 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d851f1cf-1185-41fe-8e1a-c36659e43db6 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:49:09.221735 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d851f1cf-1185-41fe-8e1a-c36659e43db6 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:49:09.339924 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-d851f1cf-1185-41fe-8e1a-c36659e43db6 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5af28c28d4044fe8b57978dd4b775e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268453b6c33d4cc0a6486da778b00f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:49:09.347189 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-d851f1cf-1185-41fe-8e1a-c36659e43db6 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/1d185186-1575-4963-91f6-9f35533b06fa" status: 200 len: 1451 microversion: 2.1 time: 0.137866 Aug 27 04:49:09.347749 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 754/1502] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:49:09 2021] GET /compute/v2.1/servers/1d185186-1575-4963-91f6-9f35533b06fa => generated 1451 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:49:11.175165 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [req-6a9d49b3-839e-4702-a8e3-d8183a4e9af0 req-da208978-8f83-451e-a85a-2f20004eb3ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d185186-1575-4963-91f6-9f35533b06fa", "tag": "4b35c1d5-7c3f-461b-b444-c493c38fa554"}]} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:49:11.177183 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:49:11.177183 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: warnings.warn(msg) Aug 27 04:49:11.187074 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-6a9d49b3-839e-4702-a8e3-d8183a4e9af0 req-da208978-8f83-451e-a85a-2f20004eb3ba service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:49:11.187743 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-6a9d49b3-839e-4702-a8e3-d8183a4e9af0 req-da208978-8f83-451e-a85a-2f20004eb3ba service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:49:11.199494 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.compute.server_external_events [req-6a9d49b3-839e-4702-a8e3-d8183a4e9af0 req-da208978-8f83-451e-a85a-2f20004eb3ba service nova] Creating event network-changed:4b35c1d5-7c3f-461b-b444-c493c38fa554 for instance 1d185186-1575-4963-91f6-9f35533b06fa on hv-cinder-80403 Aug 27 04:49:11.204718 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [req-6a9d49b3-839e-4702-a8e3-d8183a4e9af0 req-da208978-8f83-451e-a85a-2f20004eb3ba service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033403 Aug 27 04:49:11.205525 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 749/1503] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:49:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:49:20.938570 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:49:20.939574 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: Fri Aug 27 04:49:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:51:07.677859 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:51:07.678440 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: Fri Aug 27 04:51:07 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:51:19.547126 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:51:19.547762 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: Fri Aug 27 04:51:19 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:51:21.937821 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:51:21.938287 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: Fri Aug 27 04:51:21 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:51:25.643722 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f0f36fda-08d4-4c1a-88ce-2c1dbccccae7] AMQP server on 10.222.0.53:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:51:25.647389 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-d81e75b4-9d63-4838-8627-d85a4292b4db tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1967504085", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-725197301", "security_groups": [{"name": "tempest-secgroup-smoke-440466660"}], "block_device_mapping_v2": [{"uuid": "ce13688f-b92e-4ce4-9b02-8553a8dad2ad", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1818e3b3-3df5-4098-8cd9-7e007e79848c"}]}} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:51:25.750180 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.network.neutron [None req-d81e75b4-9d63-4838-8627-d85a4292b4db tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] validate_networks() for [('1818e3b3-3df5-4098-8cd9-7e007e79848c', None, None, None, None, None)] {{(pid=108971) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 04:51:26.205385 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.virt.hardware [None req-d81e75b4-9d63-4838-8627-d85a4292b4db tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Flavor limits 0:0:0 {{(pid=108971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:51:26.205804 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.virt.hardware [None req-d81e75b4-9d63-4838-8627-d85a4292b4db tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Image limits 0:0:0 {{(pid=108971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:51:26.206276 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.virt.hardware [None req-d81e75b4-9d63-4838-8627-d85a4292b4db tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Flavor pref 0:0:0 {{(pid=108971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:51:26.207197 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.virt.hardware [None req-d81e75b4-9d63-4838-8627-d85a4292b4db tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Image pref 0:0:0 {{(pid=108971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:51:26.207607 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.virt.hardware [None req-d81e75b4-9d63-4838-8627-d85a4292b4db tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:51:26.216241 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d81e75b4-9d63-4838-8627-d85a4292b4db tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:51:26.216691 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d81e75b4-9d63-4838-8627-d85a4292b4db tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:51:26.217494 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d81e75b4-9d63-4838-8627-d85a4292b4db tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:51:26.217930 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d81e75b4-9d63-4838-8627-d85a4292b4db tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:51:26.234826 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.quota [None req-d81e75b4-9d63-4838-8627-d85a4292b4db tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Getting quotas for project 268453b6c33d4cc0a6486da778b00f9b. Resources: {'ram', 'cores', 'instances'} {{(pid=108971) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:51:26.238729 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.quota [None req-d81e75b4-9d63-4838-8627-d85a4292b4db tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Getting quotas for user c5af28c28d4044fe8b57978dd4b775e3 and project 268453b6c33d4cc0a6486da778b00f9b. Resources: {'ram', 'cores', 'instances'} {{(pid=108971) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:51:26.296983 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-d81e75b4-9d63-4838-8627-d85a4292b4db tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Going to run 1 instances... {{(pid=108971) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 04:51:26.299138 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-d81e75b4-9d63-4838-8627-d85a4292b4db tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 6ab7cbf1-6140-4162-af60-38f48f08e381] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ce13688f-b92e-4ce4-9b02-8553a8dad2ad',volume_size=None,volume_type=None)] {{(pid=108971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 04:51:26.419919 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-d81e75b4-9d63-4838-8627-d85a4292b4db tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.777746 Aug 27 04:51:26.420614 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 755/1504] 10.222.0.53 () {60 vars in 1147 bytes} [Fri Aug 27 04:51:25 2021] POST /compute/v2.1/servers => generated 405 bytes in 779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:51:26.432198 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-fdadb154-61ec-4706-bbd2-f03a7c0e49bf tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:26.433244 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-fdadb154-61ec-4706-bbd2-f03a7c0e49bf tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 6ab7cbf1-6140-4162-af60-38f48f08e381] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:51:26.487245 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-fdadb154-61ec-4706-bbd2-f03a7c0e49bf tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5af28c28d4044fe8b57978dd4b775e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268453b6c33d4cc0a6486da778b00f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:26.494425 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-fdadb154-61ec-4706-bbd2-f03a7c0e49bf tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/6ab7cbf1-6140-4162-af60-38f48f08e381" status: 200 len: 1094 microversion: 2.1 time: 0.067595 Aug 27 04:51:26.494967 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 750/1505] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:51:26 2021] GET /compute/v2.1/servers/6ab7cbf1-6140-4162-af60-38f48f08e381 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:51:27.511110 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-a85a0b9e-d351-432b-9e9c-80113f256428 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:27.511730 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-a85a0b9e-d351-432b-9e9c-80113f256428 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 6ab7cbf1-6140-4162-af60-38f48f08e381] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:51:27.528592 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a85a0b9e-d351-432b-9e9c-80113f256428 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:51:27.529040 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a85a0b9e-d351-432b-9e9c-80113f256428 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:51:27.529818 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a85a0b9e-d351-432b-9e9c-80113f256428 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:51:27.530264 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a85a0b9e-d351-432b-9e9c-80113f256428 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:51:27.536618 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO oslo.messaging._drivers.impl_rabbit [-] [f0f36fda-08d4-4c1a-88ce-2c1dbccccae7] Reconnected to AMQP server on 10.222.0.53:5672 via [amqp] client with port 48018. Aug 27 04:51:27.594049 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-a85a0b9e-d351-432b-9e9c-80113f256428 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5af28c28d4044fe8b57978dd4b775e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268453b6c33d4cc0a6486da778b00f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:27.601708 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-a85a0b9e-d351-432b-9e9c-80113f256428 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/6ab7cbf1-6140-4162-af60-38f48f08e381" status: 200 len: 1210 microversion: 2.1 time: 0.094210 Aug 27 04:51:27.602283 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 756/1506] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:51:27 2021] GET /compute/v2.1/servers/6ab7cbf1-6140-4162-af60-38f48f08e381 => generated 1210 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:28.618547 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-6d9a8f90-d582-46f3-a95e-4bd933ce27aa tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:28.619065 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-6d9a8f90-d582-46f3-a95e-4bd933ce27aa tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 6ab7cbf1-6140-4162-af60-38f48f08e381] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:51:28.625048 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6d9a8f90-d582-46f3-a95e-4bd933ce27aa tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:51:28.625492 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6d9a8f90-d582-46f3-a95e-4bd933ce27aa tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:51:28.626264 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6d9a8f90-d582-46f3-a95e-4bd933ce27aa tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:51:28.626696 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-6d9a8f90-d582-46f3-a95e-4bd933ce27aa tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:51:28.794236 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [req-47b29e14-70e1-4985-87a1-8f805004ac4a req-33b33fb1-8c51-4930-b0c0-59c68de426a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ab7cbf1-6140-4162-af60-38f48f08e381", "tag": "ad6cae03-0bbd-4dda-a21e-9952ba784493"}]} {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:51:28.795796 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:51:28.795796 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: warnings.warn(msg) Aug 27 04:51:28.802806 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-47b29e14-70e1-4985-87a1-8f805004ac4a req-33b33fb1-8c51-4930-b0c0-59c68de426a3 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:51:28.803249 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [req-47b29e14-70e1-4985-87a1-8f805004ac4a req-33b33fb1-8c51-4930-b0c0-59c68de426a3 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:51:28.814078 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.compute.server_external_events [req-47b29e14-70e1-4985-87a1-8f805004ac4a req-33b33fb1-8c51-4930-b0c0-59c68de426a3 service nova] Creating event network-changed:ad6cae03-0bbd-4dda-a21e-9952ba784493 for instance 6ab7cbf1-6140-4162-af60-38f48f08e381 on hv-cinder-80403 Aug 27 04:51:28.821026 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [req-47b29e14-70e1-4985-87a1-8f805004ac4a req-33b33fb1-8c51-4930-b0c0-59c68de426a3 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098467 Aug 27 04:51:28.821925 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 757/1507] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:51:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:51:28.843658 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-6d9a8f90-d582-46f3-a95e-4bd933ce27aa tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5af28c28d4044fe8b57978dd4b775e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268453b6c33d4cc0a6486da778b00f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:28.855441 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-6d9a8f90-d582-46f3-a95e-4bd933ce27aa tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/6ab7cbf1-6140-4162-af60-38f48f08e381" status: 200 len: 1265 microversion: 2.1 time: 0.240577 Aug 27 04:51:28.856204 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 751/1508] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:51:28 2021] GET /compute/v2.1/servers/6ab7cbf1-6140-4162-af60-38f48f08e381 => generated 1265 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:29.874062 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-f11ffeb1-56ff-43cd-8eb0-0b0a800b5b7a tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:29.874763 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-f11ffeb1-56ff-43cd-8eb0-0b0a800b5b7a tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 6ab7cbf1-6140-4162-af60-38f48f08e381] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:51:29.881364 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f11ffeb1-56ff-43cd-8eb0-0b0a800b5b7a tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:51:29.881816 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f11ffeb1-56ff-43cd-8eb0-0b0a800b5b7a tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:51:29.882590 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f11ffeb1-56ff-43cd-8eb0-0b0a800b5b7a tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:51:29.883030 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-f11ffeb1-56ff-43cd-8eb0-0b0a800b5b7a tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:51:30.000748 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-f11ffeb1-56ff-43cd-8eb0-0b0a800b5b7a tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5af28c28d4044fe8b57978dd4b775e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268453b6c33d4cc0a6486da778b00f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:30.007938 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-f11ffeb1-56ff-43cd-8eb0-0b0a800b5b7a tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/6ab7cbf1-6140-4162-af60-38f48f08e381" status: 200 len: 1265 microversion: 2.1 time: 0.137905 Aug 27 04:51:30.008527 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 758/1509] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:51:29 2021] GET /compute/v2.1/servers/6ab7cbf1-6140-4162-af60-38f48f08e381 => generated 1265 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:31.024627 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-86c3fbfb-9252-42b6-aa19-af1976efa86a tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:31.025270 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-86c3fbfb-9252-42b6-aa19-af1976efa86a tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 6ab7cbf1-6140-4162-af60-38f48f08e381] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:51:31.031134 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-86c3fbfb-9252-42b6-aa19-af1976efa86a tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:51:31.031591 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-86c3fbfb-9252-42b6-aa19-af1976efa86a tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:51:31.032404 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-86c3fbfb-9252-42b6-aa19-af1976efa86a tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:51:31.032854 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-86c3fbfb-9252-42b6-aa19-af1976efa86a tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:51:31.151019 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-86c3fbfb-9252-42b6-aa19-af1976efa86a tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5af28c28d4044fe8b57978dd4b775e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268453b6c33d4cc0a6486da778b00f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:31.158465 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-86c3fbfb-9252-42b6-aa19-af1976efa86a tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/6ab7cbf1-6140-4162-af60-38f48f08e381" status: 200 len: 1265 microversion: 2.1 time: 0.137303 Aug 27 04:51:31.159032 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 752/1510] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:51:31 2021] GET /compute/v2.1/servers/6ab7cbf1-6140-4162-af60-38f48f08e381 => generated 1265 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:32.174442 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-9b18b3c7-0174-41df-81e3-38da6f00c84c tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:32.175048 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-9b18b3c7-0174-41df-81e3-38da6f00c84c tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 6ab7cbf1-6140-4162-af60-38f48f08e381] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:51:32.180856 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9b18b3c7-0174-41df-81e3-38da6f00c84c tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:51:32.181295 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9b18b3c7-0174-41df-81e3-38da6f00c84c tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:51:32.182154 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9b18b3c7-0174-41df-81e3-38da6f00c84c tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:51:32.182511 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9b18b3c7-0174-41df-81e3-38da6f00c84c tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:51:32.300721 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-9b18b3c7-0174-41df-81e3-38da6f00c84c tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5af28c28d4044fe8b57978dd4b775e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268453b6c33d4cc0a6486da778b00f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:32.307836 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-9b18b3c7-0174-41df-81e3-38da6f00c84c tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/6ab7cbf1-6140-4162-af60-38f48f08e381" status: 200 len: 1265 microversion: 2.1 time: 0.137046 Aug 27 04:51:32.308437 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 759/1511] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:51:32 2021] GET /compute/v2.1/servers/6ab7cbf1-6140-4162-af60-38f48f08e381 => generated 1265 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:33.325093 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-9bf8be42-215d-46da-9096-d98617674c49 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:33.325717 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-9bf8be42-215d-46da-9096-d98617674c49 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 6ab7cbf1-6140-4162-af60-38f48f08e381] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:51:33.331571 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9bf8be42-215d-46da-9096-d98617674c49 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:51:33.332047 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9bf8be42-215d-46da-9096-d98617674c49 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:51:33.332827 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9bf8be42-215d-46da-9096-d98617674c49 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:51:33.333269 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-9bf8be42-215d-46da-9096-d98617674c49 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:51:33.449199 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-9bf8be42-215d-46da-9096-d98617674c49 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5af28c28d4044fe8b57978dd4b775e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268453b6c33d4cc0a6486da778b00f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:33.456445 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-9bf8be42-215d-46da-9096-d98617674c49 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/6ab7cbf1-6140-4162-af60-38f48f08e381" status: 200 len: 1265 microversion: 2.1 time: 0.135062 Aug 27 04:51:33.457479 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 753/1512] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:51:33 2021] GET /compute/v2.1/servers/6ab7cbf1-6140-4162-af60-38f48f08e381 => generated 1265 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:34.473646 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-d15fc392-700c-4cf3-ab59-9f2593a2f73c tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:34.474248 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-d15fc392-700c-4cf3-ab59-9f2593a2f73c tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 6ab7cbf1-6140-4162-af60-38f48f08e381] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:51:34.480332 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d15fc392-700c-4cf3-ab59-9f2593a2f73c tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:51:34.480775 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d15fc392-700c-4cf3-ab59-9f2593a2f73c tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:51:34.481526 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d15fc392-700c-4cf3-ab59-9f2593a2f73c tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:51:34.481951 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-d15fc392-700c-4cf3-ab59-9f2593a2f73c tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:51:34.604239 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-d15fc392-700c-4cf3-ab59-9f2593a2f73c tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5af28c28d4044fe8b57978dd4b775e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268453b6c33d4cc0a6486da778b00f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:34.611466 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-d15fc392-700c-4cf3-ab59-9f2593a2f73c tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/6ab7cbf1-6140-4162-af60-38f48f08e381" status: 200 len: 1265 microversion: 2.1 time: 0.142019 Aug 27 04:51:34.612258 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 760/1513] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:51:34 2021] GET /compute/v2.1/servers/6ab7cbf1-6140-4162-af60-38f48f08e381 => generated 1265 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:35.628438 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-abc49944-2cbb-4e08-bb05-bed3cd283bd8 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:35.629598 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-abc49944-2cbb-4e08-bb05-bed3cd283bd8 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 6ab7cbf1-6140-4162-af60-38f48f08e381] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:51:35.635461 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-abc49944-2cbb-4e08-bb05-bed3cd283bd8 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:51:35.635910 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-abc49944-2cbb-4e08-bb05-bed3cd283bd8 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:51:35.636716 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-abc49944-2cbb-4e08-bb05-bed3cd283bd8 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:51:35.637151 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-abc49944-2cbb-4e08-bb05-bed3cd283bd8 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:51:35.756423 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-abc49944-2cbb-4e08-bb05-bed3cd283bd8 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5af28c28d4044fe8b57978dd4b775e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268453b6c33d4cc0a6486da778b00f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:35.763706 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-abc49944-2cbb-4e08-bb05-bed3cd283bd8 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/6ab7cbf1-6140-4162-af60-38f48f08e381" status: 200 len: 1265 microversion: 2.1 time: 0.139026 Aug 27 04:51:35.764307 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 754/1514] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:51:35 2021] GET /compute/v2.1/servers/6ab7cbf1-6140-4162-af60-38f48f08e381 => generated 1265 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:36.780359 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-3214c683-c288-4228-8c4f-7ac4edb7476f tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:36.781004 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-3214c683-c288-4228-8c4f-7ac4edb7476f tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 6ab7cbf1-6140-4162-af60-38f48f08e381] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:51:36.787014 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3214c683-c288-4228-8c4f-7ac4edb7476f tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:51:36.787459 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3214c683-c288-4228-8c4f-7ac4edb7476f tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:51:36.788249 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3214c683-c288-4228-8c4f-7ac4edb7476f tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:51:36.788683 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3214c683-c288-4228-8c4f-7ac4edb7476f tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:51:36.906315 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-3214c683-c288-4228-8c4f-7ac4edb7476f tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5af28c28d4044fe8b57978dd4b775e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268453b6c33d4cc0a6486da778b00f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:36.913590 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-3214c683-c288-4228-8c4f-7ac4edb7476f tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/6ab7cbf1-6140-4162-af60-38f48f08e381" status: 200 len: 1265 microversion: 2.1 time: 0.136864 Aug 27 04:51:36.914164 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 761/1515] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:51:36 2021] GET /compute/v2.1/servers/6ab7cbf1-6140-4162-af60-38f48f08e381 => generated 1265 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:37.930168 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-b9143110-d39a-4c7e-a020-ee3856130351 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:37.930779 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-b9143110-d39a-4c7e-a020-ee3856130351 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 6ab7cbf1-6140-4162-af60-38f48f08e381] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:51:37.936933 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b9143110-d39a-4c7e-a020-ee3856130351 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:51:37.937379 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b9143110-d39a-4c7e-a020-ee3856130351 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:51:37.938143 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b9143110-d39a-4c7e-a020-ee3856130351 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:51:37.938574 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-b9143110-d39a-4c7e-a020-ee3856130351 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:51:38.058115 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-b9143110-d39a-4c7e-a020-ee3856130351 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5af28c28d4044fe8b57978dd4b775e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268453b6c33d4cc0a6486da778b00f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:38.065242 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-b9143110-d39a-4c7e-a020-ee3856130351 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/6ab7cbf1-6140-4162-af60-38f48f08e381" status: 200 len: 1265 microversion: 2.1 time: 0.138752 Aug 27 04:51:38.065796 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 755/1516] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:51:37 2021] GET /compute/v2.1/servers/6ab7cbf1-6140-4162-af60-38f48f08e381 => generated 1265 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:39.081835 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-a79bbbeb-5128-419d-90b2-9d0fe1a9adfb tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:39.082450 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-a79bbbeb-5128-419d-90b2-9d0fe1a9adfb tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 6ab7cbf1-6140-4162-af60-38f48f08e381] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:51:39.088126 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a79bbbeb-5128-419d-90b2-9d0fe1a9adfb tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:51:39.088569 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a79bbbeb-5128-419d-90b2-9d0fe1a9adfb tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:51:39.089332 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a79bbbeb-5128-419d-90b2-9d0fe1a9adfb tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:51:39.089755 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-a79bbbeb-5128-419d-90b2-9d0fe1a9adfb tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:51:39.211477 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-a79bbbeb-5128-419d-90b2-9d0fe1a9adfb tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5af28c28d4044fe8b57978dd4b775e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268453b6c33d4cc0a6486da778b00f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:39.218894 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-a79bbbeb-5128-419d-90b2-9d0fe1a9adfb tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/6ab7cbf1-6140-4162-af60-38f48f08e381" status: 200 len: 1265 microversion: 2.1 time: 0.140687 Aug 27 04:51:39.219627 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 762/1517] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:51:39 2021] GET /compute/v2.1/servers/6ab7cbf1-6140-4162-af60-38f48f08e381 => generated 1265 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:39.220760 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [req-62ae014b-4a83-4469-b1b6-370b0ab39180 req-00c03593-d435-401d-9957-af5faa011107 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ab7cbf1-6140-4162-af60-38f48f08e381", "name": "network-vif-plugged", "status": "completed", "tag": "ad6cae03-0bbd-4dda-a21e-9952ba784493"}]} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:51:39.223592 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:51:39.223592 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: warnings.warn(msg) Aug 27 04:51:39.231526 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-62ae014b-4a83-4469-b1b6-370b0ab39180 req-00c03593-d435-401d-9957-af5faa011107 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:51:39.231978 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-62ae014b-4a83-4469-b1b6-370b0ab39180 req-00c03593-d435-401d-9957-af5faa011107 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:51:39.243722 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.compute.server_external_events [req-62ae014b-4a83-4469-b1b6-370b0ab39180 req-00c03593-d435-401d-9957-af5faa011107 service nova] Creating event network-vif-plugged:ad6cae03-0bbd-4dda-a21e-9952ba784493 for instance 6ab7cbf1-6140-4162-af60-38f48f08e381 on hv-cinder-80403 Aug 27 04:51:39.250752 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [req-62ae014b-4a83-4469-b1b6-370b0ab39180 req-00c03593-d435-401d-9957-af5faa011107 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034337 Aug 27 04:51:39.251719 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 756/1518] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:51:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:51:39.342850 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:51:39.343058 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: Fri Aug 27 04:51:39 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:51:40.235908 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-cf2c2d6e-b638-422b-8b06-af8c09d8faf7 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:40.236628 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-cf2c2d6e-b638-422b-8b06-af8c09d8faf7 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 6ab7cbf1-6140-4162-af60-38f48f08e381] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:51:40.242910 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cf2c2d6e-b638-422b-8b06-af8c09d8faf7 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:51:40.243349 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cf2c2d6e-b638-422b-8b06-af8c09d8faf7 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:51:40.244135 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cf2c2d6e-b638-422b-8b06-af8c09d8faf7 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:51:40.244566 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-cf2c2d6e-b638-422b-8b06-af8c09d8faf7 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:51:40.369772 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-cf2c2d6e-b638-422b-8b06-af8c09d8faf7 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5af28c28d4044fe8b57978dd4b775e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268453b6c33d4cc0a6486da778b00f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:40.377215 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-cf2c2d6e-b638-422b-8b06-af8c09d8faf7 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/6ab7cbf1-6140-4162-af60-38f48f08e381" status: 200 len: 1265 microversion: 2.1 time: 0.144970 Aug 27 04:51:40.377779 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 763/1519] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:51:40 2021] GET /compute/v2.1/servers/6ab7cbf1-6140-4162-af60-38f48f08e381 => generated 1265 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:41.396738 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-0e12d4d1-dc79-43db-ab0c-faf614830b4c tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:41.397443 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-0e12d4d1-dc79-43db-ab0c-faf614830b4c tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 6ab7cbf1-6140-4162-af60-38f48f08e381] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:51:41.403512 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0e12d4d1-dc79-43db-ab0c-faf614830b4c tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:51:41.403965 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0e12d4d1-dc79-43db-ab0c-faf614830b4c tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:51:41.404759 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0e12d4d1-dc79-43db-ab0c-faf614830b4c tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:51:41.405204 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-0e12d4d1-dc79-43db-ab0c-faf614830b4c tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:51:41.526716 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-0e12d4d1-dc79-43db-ab0c-faf614830b4c tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5af28c28d4044fe8b57978dd4b775e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268453b6c33d4cc0a6486da778b00f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:41.533975 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-0e12d4d1-dc79-43db-ab0c-faf614830b4c tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/6ab7cbf1-6140-4162-af60-38f48f08e381" status: 200 len: 1452 microversion: 2.1 time: 0.141924 Aug 27 04:51:41.534538 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 757/1520] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:51:41 2021] GET /compute/v2.1/servers/6ab7cbf1-6140-4162-af60-38f48f08e381 => generated 1452 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:41.549653 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-1b261bb5-f531-4808-bd34-30e983dd87a9 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:51:41.550268 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-1b261bb5-f531-4808-bd34-30e983dd87a9 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 6ab7cbf1-6140-4162-af60-38f48f08e381] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:51:41.556105 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1b261bb5-f531-4808-bd34-30e983dd87a9 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:51:41.556558 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1b261bb5-f531-4808-bd34-30e983dd87a9 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:51:41.557325 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1b261bb5-f531-4808-bd34-30e983dd87a9 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:51:41.557763 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-1b261bb5-f531-4808-bd34-30e983dd87a9 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:51:41.674500 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-1b261bb5-f531-4808-bd34-30e983dd87a9 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5af28c28d4044fe8b57978dd4b775e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268453b6c33d4cc0a6486da778b00f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:51:41.682228 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-1b261bb5-f531-4808-bd34-30e983dd87a9 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/6ab7cbf1-6140-4162-af60-38f48f08e381" status: 200 len: 1452 microversion: 2.1 time: 0.136338 Aug 27 04:51:41.682790 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 764/1521] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:51:41 2021] GET /compute/v2.1/servers/6ab7cbf1-6140-4162-af60-38f48f08e381 => generated 1452 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:51:43.419154 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [req-9b9f5415-c556-4384-ade3-a689f90241cf req-b8d3605f-f249-4cd6-bca1-992c454c64d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ab7cbf1-6140-4162-af60-38f48f08e381", "tag": "ad6cae03-0bbd-4dda-a21e-9952ba784493"}]} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:51:43.420663 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:51:43.420663 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: warnings.warn(msg) Aug 27 04:51:43.427876 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-9b9f5415-c556-4384-ade3-a689f90241cf req-b8d3605f-f249-4cd6-bca1-992c454c64d9 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:51:43.428351 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-9b9f5415-c556-4384-ade3-a689f90241cf req-b8d3605f-f249-4cd6-bca1-992c454c64d9 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:51:43.438946 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.compute.server_external_events [req-9b9f5415-c556-4384-ade3-a689f90241cf req-b8d3605f-f249-4cd6-bca1-992c454c64d9 service nova] Creating event network-changed:ad6cae03-0bbd-4dda-a21e-9952ba784493 for instance 6ab7cbf1-6140-4162-af60-38f48f08e381 on hv-cinder-80403 Aug 27 04:51:43.444829 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [req-9b9f5415-c556-4384-ade3-a689f90241cf req-b8d3605f-f249-4cd6-bca1-992c454c64d9 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087520 Aug 27 04:51:43.445613 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 758/1522] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:51:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:52:39.398302 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:52:39.398873 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: Fri Aug 27 04:52:39 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:52:40.957881 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:52:40.958531 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: Fri Aug 27 04:52:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:53:32.024131 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-b227ef4c-9020-46af-8b1d-aae8f6a4d65e tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:32.024663 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dae29848-fd8d-49a8-9138-77fd52175e15] AMQP server on 10.222.0.53:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 04:53:32.025036 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-b227ef4c-9020-46af-8b1d-aae8f6a4d65e tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 6ab7cbf1-6140-4162-af60-38f48f08e381] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:53:32.028700 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [req-291fae36-1156-4d17-8ed4-2ced36da597c req-88d7254e-852f-4284-ba9f-a6c3cb6ffc26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ab7cbf1-6140-4162-af60-38f48f08e381", "tag": "ad6cae03-0bbd-4dda-a21e-9952ba784493"}]} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:32.031141 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:53:32.031141 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: warnings.warn(msg) Aug 27 04:53:32.031358 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b227ef4c-9020-46af-8b1d-aae8f6a4d65e tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:53:32.031873 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b227ef4c-9020-46af-8b1d-aae8f6a4d65e tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:53:32.032755 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b227ef4c-9020-46af-8b1d-aae8f6a4d65e tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:53:32.033262 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-b227ef4c-9020-46af-8b1d-aae8f6a4d65e tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:53:32.038891 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-291fae36-1156-4d17-8ed4-2ced36da597c req-88d7254e-852f-4284-ba9f-a6c3cb6ffc26 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:53:32.039333 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-291fae36-1156-4d17-8ed4-2ced36da597c req-88d7254e-852f-4284-ba9f-a6c3cb6ffc26 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:53:32.050874 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.compute.server_external_events [req-291fae36-1156-4d17-8ed4-2ced36da597c req-88d7254e-852f-4284-ba9f-a6c3cb6ffc26 service nova] Creating event network-changed:ad6cae03-0bbd-4dda-a21e-9952ba784493 for instance 6ab7cbf1-6140-4162-af60-38f48f08e381 on hv-cinder-80403 Aug 27 04:53:32.057056 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [req-291fae36-1156-4d17-8ed4-2ced36da597c req-88d7254e-852f-4284-ba9f-a6c3cb6ffc26 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034207 Aug 27 04:53:32.057858 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 759/1523] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:53:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:53:32.061031 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-b227ef4c-9020-46af-8b1d-aae8f6a4d65e tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 6ab7cbf1-6140-4162-af60-38f48f08e381] Going to try to terminate instance {{(pid=108971) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 04:53:32.148190 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-b227ef4c-9020-46af-8b1d-aae8f6a4d65e tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "DELETE /compute/v2.1/servers/6ab7cbf1-6140-4162-af60-38f48f08e381" status: 204 len: 0 microversion: 2.1 time: 0.128165 Aug 27 04:53:32.152863 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 765/1524] 10.222.0.53 () {58 vars in 1239 bytes} [Fri Aug 27 04:53:32 2021] DELETE /compute/v2.1/servers/6ab7cbf1-6140-4162-af60-38f48f08e381 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:53:32.159235 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-1d26023d-b7e9-49a3-adb7-cb3e50d191fd tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:32.160035 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-1d26023d-b7e9-49a3-adb7-cb3e50d191fd tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 6ab7cbf1-6140-4162-af60-38f48f08e381] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:53:32.166748 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1d26023d-b7e9-49a3-adb7-cb3e50d191fd tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:53:32.167208 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1d26023d-b7e9-49a3-adb7-cb3e50d191fd tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:53:32.168030 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1d26023d-b7e9-49a3-adb7-cb3e50d191fd tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:53:32.168451 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-1d26023d-b7e9-49a3-adb7-cb3e50d191fd tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:53:32.503348 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-1d26023d-b7e9-49a3-adb7-cb3e50d191fd tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5af28c28d4044fe8b57978dd4b775e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268453b6c33d4cc0a6486da778b00f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:32.518536 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-1d26023d-b7e9-49a3-adb7-cb3e50d191fd tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/6ab7cbf1-6140-4162-af60-38f48f08e381" status: 200 len: 1577 microversion: 2.1 time: 0.364093 Aug 27 04:53:32.519310 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 760/1525] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:53:32 2021] GET /compute/v2.1/servers/6ab7cbf1-6140-4162-af60-38f48f08e381 => generated 1577 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:33.537039 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-01a666ef-4963-4f9e-9881-b448ac9528c8 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:33.537732 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-01a666ef-4963-4f9e-9881-b448ac9528c8 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 6ab7cbf1-6140-4162-af60-38f48f08e381] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:53:33.544137 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-01a666ef-4963-4f9e-9881-b448ac9528c8 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:53:33.544586 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-01a666ef-4963-4f9e-9881-b448ac9528c8 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:53:33.545341 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-01a666ef-4963-4f9e-9881-b448ac9528c8 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:53:33.545773 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-01a666ef-4963-4f9e-9881-b448ac9528c8 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:53:33.737973 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-01a666ef-4963-4f9e-9881-b448ac9528c8 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5af28c28d4044fe8b57978dd4b775e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268453b6c33d4cc0a6486da778b00f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:33.745843 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-01a666ef-4963-4f9e-9881-b448ac9528c8 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/6ab7cbf1-6140-4162-af60-38f48f08e381" status: 200 len: 1458 microversion: 2.1 time: 0.212888 Aug 27 04:53:33.746408 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 766/1526] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:53:33 2021] GET /compute/v2.1/servers/6ab7cbf1-6140-4162-af60-38f48f08e381 => generated 1458 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:34.533161 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [req-7cf0afb8-9ef3-4522-980f-379be5ff5d69 req-3929734d-46f8-4c01-8374-6722910cb5ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ab7cbf1-6140-4162-af60-38f48f08e381", "name": "network-vif-deleted", "tag": "ad6cae03-0bbd-4dda-a21e-9952ba784493"}]} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:34.534657 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:53:34.534657 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: warnings.warn(msg) Aug 27 04:53:34.552543 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-7cf0afb8-9ef3-4522-980f-379be5ff5d69 req-3929734d-46f8-4c01-8374-6722910cb5ff service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:53:34.552987 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-7cf0afb8-9ef3-4522-980f-379be5ff5d69 req-3929734d-46f8-4c01-8374-6722910cb5ff service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:53:34.563913 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO oslo.messaging._drivers.impl_rabbit [-] [dae29848-fd8d-49a8-9138-77fd52175e15] Reconnected to AMQP server on 10.222.0.53:5672 via [amqp] client with port 48120. Aug 27 04:53:34.565813 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.compute.server_external_events [req-7cf0afb8-9ef3-4522-980f-379be5ff5d69 req-3929734d-46f8-4c01-8374-6722910cb5ff service nova] Creating event network-vif-deleted:ad6cae03-0bbd-4dda-a21e-9952ba784493 for instance 6ab7cbf1-6140-4162-af60-38f48f08e381 on hv-cinder-80403 Aug 27 04:53:34.570530 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [req-7cf0afb8-9ef3-4522-980f-379be5ff5d69 req-3929734d-46f8-4c01-8374-6722910cb5ff service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041156 Aug 27 04:53:34.571638 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 761/1527] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:53:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:53:34.764801 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-6495b7e9-dced-4bda-885f-530e10303662 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:34.765421 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-6495b7e9-dced-4bda-885f-530e10303662 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 6ab7cbf1-6140-4162-af60-38f48f08e381] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:53:34.771158 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6495b7e9-dced-4bda-885f-530e10303662 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:53:34.771607 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6495b7e9-dced-4bda-885f-530e10303662 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:53:34.772410 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6495b7e9-dced-4bda-885f-530e10303662 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:53:34.772846 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-6495b7e9-dced-4bda-885f-530e10303662 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:53:34.832844 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-6495b7e9-dced-4bda-885f-530e10303662 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5af28c28d4044fe8b57978dd4b775e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268453b6c33d4cc0a6486da778b00f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:34.840739 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-6495b7e9-dced-4bda-885f-530e10303662 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/6ab7cbf1-6140-4162-af60-38f48f08e381" status: 200 len: 1225 microversion: 2.1 time: 0.079532 Aug 27 04:53:34.841519 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 767/1528] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:53:34 2021] GET /compute/v2.1/servers/6ab7cbf1-6140-4162-af60-38f48f08e381 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:35.858809 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-5a095630-54e0-40e3-b5ba-1f2bfef49e2b tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:35.859510 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-5a095630-54e0-40e3-b5ba-1f2bfef49e2b tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 6ab7cbf1-6140-4162-af60-38f48f08e381] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:53:35.865652 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5a095630-54e0-40e3-b5ba-1f2bfef49e2b tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:53:35.866107 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5a095630-54e0-40e3-b5ba-1f2bfef49e2b tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:53:35.866878 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5a095630-54e0-40e3-b5ba-1f2bfef49e2b tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:53:35.867320 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-5a095630-54e0-40e3-b5ba-1f2bfef49e2b tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:53:35.881155 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.wsgi [None req-5a095630-54e0-40e3-b5ba-1f2bfef49e2b tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] HTTP exception thrown: Instance 6ab7cbf1-6140-4162-af60-38f48f08e381 could not be found. Aug 27 04:53:35.881736 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-5a095630-54e0-40e3-b5ba-1f2bfef49e2b tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Returning 404 to user: Instance 6ab7cbf1-6140-4162-af60-38f48f08e381 could not be found. {{(pid=108970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:53:35.882544 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-5a095630-54e0-40e3-b5ba-1f2bfef49e2b tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/6ab7cbf1-6140-4162-af60-38f48f08e381" status: 404 len: 111 microversion: 2.1 time: 0.027826 Aug 27 04:53:35.883064 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 762/1529] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:53:35 2021] GET /compute/v2.1/servers/6ab7cbf1-6140-4162-af60-38f48f08e381 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:53:38.910219 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-9b472607-a07a-4221-9207-4d79a17c487c tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:38.910727 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-9b472607-a07a-4221-9207-4d79a17c487c tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 1d185186-1575-4963-91f6-9f35533b06fa] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:53:38.912775 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [req-f8b90131-9369-4346-bb32-6fe27e28d8cc req-6477cc23-fc73-4586-9b07-d93bc9821e73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d185186-1575-4963-91f6-9f35533b06fa", "tag": "4b35c1d5-7c3f-461b-b444-c493c38fa554"}]} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:38.914392 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:53:38.914392 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: warnings.warn(msg) Aug 27 04:53:38.917142 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9b472607-a07a-4221-9207-4d79a17c487c tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:53:38.917591 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9b472607-a07a-4221-9207-4d79a17c487c tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:53:38.918371 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9b472607-a07a-4221-9207-4d79a17c487c tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:53:38.918809 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-9b472607-a07a-4221-9207-4d79a17c487c tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:53:38.921794 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-f8b90131-9369-4346-bb32-6fe27e28d8cc req-6477cc23-fc73-4586-9b07-d93bc9821e73 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:53:38.922476 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-f8b90131-9369-4346-bb32-6fe27e28d8cc req-6477cc23-fc73-4586-9b07-d93bc9821e73 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:53:38.933865 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.compute.server_external_events [req-f8b90131-9369-4346-bb32-6fe27e28d8cc req-6477cc23-fc73-4586-9b07-d93bc9821e73 service nova] Creating event network-changed:4b35c1d5-7c3f-461b-b444-c493c38fa554 for instance 1d185186-1575-4963-91f6-9f35533b06fa on hv-cinder-80403 Aug 27 04:53:38.939121 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [req-f8b90131-9369-4346-bb32-6fe27e28d8cc req-6477cc23-fc73-4586-9b07-d93bc9821e73 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030187 Aug 27 04:53:38.940041 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 763/1530] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:53:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:53:38.944829 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-9b472607-a07a-4221-9207-4d79a17c487c tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 1d185186-1575-4963-91f6-9f35533b06fa] Going to try to terminate instance {{(pid=108971) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 04:53:39.047099 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-9b472607-a07a-4221-9207-4d79a17c487c tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "DELETE /compute/v2.1/servers/1d185186-1575-4963-91f6-9f35533b06fa" status: 204 len: 0 microversion: 2.1 time: 0.140341 Aug 27 04:53:39.047711 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 768/1531] 10.222.0.53 () {58 vars in 1239 bytes} [Fri Aug 27 04:53:38 2021] DELETE /compute/v2.1/servers/1d185186-1575-4963-91f6-9f35533b06fa => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:53:39.058368 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-bf4c2baa-50f5-4485-ac52-aadd693efb89 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:39.059187 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-bf4c2baa-50f5-4485-ac52-aadd693efb89 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 1d185186-1575-4963-91f6-9f35533b06fa] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:53:39.065568 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-bf4c2baa-50f5-4485-ac52-aadd693efb89 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:53:39.066110 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-bf4c2baa-50f5-4485-ac52-aadd693efb89 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:53:39.066939 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-bf4c2baa-50f5-4485-ac52-aadd693efb89 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:53:39.067444 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-bf4c2baa-50f5-4485-ac52-aadd693efb89 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:53:39.524281 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.policy [None req-bf4c2baa-50f5-4485-ac52-aadd693efb89 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5af28c28d4044fe8b57978dd4b775e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268453b6c33d4cc0a6486da778b00f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108970) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:39.540651 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-bf4c2baa-50f5-4485-ac52-aadd693efb89 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/1d185186-1575-4963-91f6-9f35533b06fa" status: 200 len: 1576 microversion: 2.1 time: 0.486590 Aug 27 04:53:39.541799 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 764/1532] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:53:39 2021] GET /compute/v2.1/servers/1d185186-1575-4963-91f6-9f35533b06fa => generated 1576 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:53:40.559063 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-3338cf9e-447a-4181-ac8c-8505b45ad1b9 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:40.559765 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-3338cf9e-447a-4181-ac8c-8505b45ad1b9 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 1d185186-1575-4963-91f6-9f35533b06fa] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:53:40.565701 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3338cf9e-447a-4181-ac8c-8505b45ad1b9 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:53:40.566146 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3338cf9e-447a-4181-ac8c-8505b45ad1b9 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:53:40.566916 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3338cf9e-447a-4181-ac8c-8505b45ad1b9 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:53:40.567353 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-3338cf9e-447a-4181-ac8c-8505b45ad1b9 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:53:40.687580 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-3338cf9e-447a-4181-ac8c-8505b45ad1b9 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5af28c28d4044fe8b57978dd4b775e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268453b6c33d4cc0a6486da778b00f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:40.694829 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-3338cf9e-447a-4181-ac8c-8505b45ad1b9 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/1d185186-1575-4963-91f6-9f35533b06fa" status: 200 len: 1457 microversion: 2.1 time: 0.139889 Aug 27 04:53:40.695396 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 769/1533] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:53:40 2021] GET /compute/v2.1/servers/1d185186-1575-4963-91f6-9f35533b06fa => generated 1457 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:41.353485 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [req-3dcc58a1-befc-4872-b876-ce8bfbd66a92 req-1b5175ef-b2ed-402c-8b9a-0d0d4efd93e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d185186-1575-4963-91f6-9f35533b06fa", "name": "network-vif-deleted", "tag": "4b35c1d5-7c3f-461b-b444-c493c38fa554"}]} {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:53:41.355050 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:53:41.355050 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: warnings.warn(msg) Aug 27 04:53:41.362010 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-3dcc58a1-befc-4872-b876-ce8bfbd66a92 req-1b5175ef-b2ed-402c-8b9a-0d0d4efd93e4 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:53:41.362464 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [req-3dcc58a1-befc-4872-b876-ce8bfbd66a92 req-1b5175ef-b2ed-402c-8b9a-0d0d4efd93e4 service nova] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:53:41.374331 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.compute.server_external_events [req-3dcc58a1-befc-4872-b876-ce8bfbd66a92 req-1b5175ef-b2ed-402c-8b9a-0d0d4efd93e4 service nova] Creating event network-vif-deleted:4b35c1d5-7c3f-461b-b444-c493c38fa554 for instance 1d185186-1575-4963-91f6-9f35533b06fa on hv-cinder-80403 Aug 27 04:53:41.379905 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [req-3dcc58a1-befc-4872-b876-ce8bfbd66a92 req-1b5175ef-b2ed-402c-8b9a-0d0d4efd93e4 service nova] 10.222.0.53 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030301 Aug 27 04:53:41.380566 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 765/1534] 10.222.0.53 () {64 vars in 1318 bytes} [Fri Aug 27 04:53:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:53:41.713578 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-48abc1d1-8ae2-4ce6-93a0-9cec952667dd tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:41.715054 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-48abc1d1-8ae2-4ce6-93a0-9cec952667dd tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 1d185186-1575-4963-91f6-9f35533b06fa] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:53:41.721477 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-48abc1d1-8ae2-4ce6-93a0-9cec952667dd tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:53:41.721926 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-48abc1d1-8ae2-4ce6-93a0-9cec952667dd tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:53:41.722979 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-48abc1d1-8ae2-4ce6-93a0-9cec952667dd tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:53:41.723411 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-48abc1d1-8ae2-4ce6-93a0-9cec952667dd tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:53:41.756081 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-48abc1d1-8ae2-4ce6-93a0-9cec952667dd tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:53:41.756529 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-48abc1d1-8ae2-4ce6-93a0-9cec952667dd tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:53:41.756979 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.objects.instance [None req-48abc1d1-8ae2-4ce6-93a0-9cec952667dd tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lazy-loading 'fault' on Instance uuid 1d185186-1575-4963-91f6-9f35533b06fa {{(pid=108971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:53:41.796004 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.policy [None req-48abc1d1-8ae2-4ce6-93a0-9cec952667dd tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5af28c28d4044fe8b57978dd4b775e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268453b6c33d4cc0a6486da778b00f9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108971) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:53:41.803162 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-48abc1d1-8ae2-4ce6-93a0-9cec952667dd tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/1d185186-1575-4963-91f6-9f35533b06fa" status: 200 len: 1230 microversion: 2.1 time: 0.093911 Aug 27 04:53:41.803724 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 770/1535] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:53:41 2021] GET /compute/v2.1/servers/1d185186-1575-4963-91f6-9f35533b06fa => generated 1230 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:53:42.820571 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-f0a2adea-cbed-4e08-9a3a-3a9a803660b2 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:42.821257 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-f0a2adea-cbed-4e08-9a3a-3a9a803660b2 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 1d185186-1575-4963-91f6-9f35533b06fa] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:53:42.827280 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f0a2adea-cbed-4e08-9a3a-3a9a803660b2 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:53:42.827726 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f0a2adea-cbed-4e08-9a3a-3a9a803660b2 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:53:42.828512 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f0a2adea-cbed-4e08-9a3a-3a9a803660b2 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:53:42.828945 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-f0a2adea-cbed-4e08-9a3a-3a9a803660b2 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:53:42.841539 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.wsgi [None req-f0a2adea-cbed-4e08-9a3a-3a9a803660b2 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] HTTP exception thrown: Instance 1d185186-1575-4963-91f6-9f35533b06fa could not be found. Aug 27 04:53:42.842115 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-f0a2adea-cbed-4e08-9a3a-3a9a803660b2 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Returning 404 to user: Instance 1d185186-1575-4963-91f6-9f35533b06fa could not be found. {{(pid=108970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:53:42.842910 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-f0a2adea-cbed-4e08-9a3a-3a9a803660b2 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/1d185186-1575-4963-91f6-9f35533b06fa" status: 404 len: 111 microversion: 2.1 time: 0.026392 Aug 27 04:53:42.843415 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 766/1536] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:53:42 2021] GET /compute/v2.1/servers/1d185186-1575-4963-91f6-9f35533b06fa => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:53:43.286193 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-48a4ea45-898d-4e75-a9fd-892b3d19cbbb tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:43.286745 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.compute.api [None req-48a4ea45-898d-4e75-a9fd-892b3d19cbbb tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 0e1ad5f4-a543-4d5f-bfcc-521717d219f7] Fetching instance by UUID {{(pid=108971) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:53:43.293229 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-48a4ea45-898d-4e75-a9fd-892b3d19cbbb tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:53:43.293674 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-48a4ea45-898d-4e75-a9fd-892b3d19cbbb tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:53:43.294426 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-48a4ea45-898d-4e75-a9fd-892b3d19cbbb tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:53:43.294893 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG oslo_concurrency.lockutils [None req-48a4ea45-898d-4e75-a9fd-892b3d19cbbb tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:53:43.307882 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.wsgi [None req-48a4ea45-898d-4e75-a9fd-892b3d19cbbb tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] HTTP exception thrown: Instance 0e1ad5f4-a543-4d5f-bfcc-521717d219f7 could not be found. Aug 27 04:53:43.308478 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-48a4ea45-898d-4e75-a9fd-892b3d19cbbb tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Returning 404 to user: Instance 0e1ad5f4-a543-4d5f-bfcc-521717d219f7 could not be found. {{(pid=108971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:53:43.309278 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-48a4ea45-898d-4e75-a9fd-892b3d19cbbb tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "DELETE /compute/v2.1/servers/0e1ad5f4-a543-4d5f-bfcc-521717d219f7" status: 404 len: 111 microversion: 2.1 time: 0.026873 Aug 27 04:53:43.309795 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 771/1537] 10.222.0.53 () {58 vars in 1239 bytes} [Fri Aug 27 04:53:43 2021] DELETE /compute/v2.1/servers/0e1ad5f4-a543-4d5f-bfcc-521717d219f7 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:53:43.317497 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-8245107b-73e2-4420-94af-940266b267b1 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '>' {{(pid=108970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:43.318105 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.compute.api [None req-8245107b-73e2-4420-94af-940266b267b1 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] [instance: 0e1ad5f4-a543-4d5f-bfcc-521717d219f7] Fetching instance by UUID {{(pid=108970) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:53:43.324421 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-8245107b-73e2-4420-94af-940266b267b1 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:53:43.324870 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-8245107b-73e2-4420-94af-940266b267b1 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:53:43.325629 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-8245107b-73e2-4420-94af-940266b267b1 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:53:43.326065 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG oslo_concurrency.lockutils [None req-8245107b-73e2-4420-94af-940266b267b1 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Lock "3f04f680-d87c-48d8-b9f0-21b73fb7deea" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:53:43.339526 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.wsgi [None req-8245107b-73e2-4420-94af-940266b267b1 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] HTTP exception thrown: Instance 0e1ad5f4-a543-4d5f-bfcc-521717d219f7 could not be found. Aug 27 04:53:43.340121 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: DEBUG nova.api.openstack.wsgi [None req-8245107b-73e2-4420-94af-940266b267b1 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Returning 404 to user: Instance 0e1ad5f4-a543-4d5f-bfcc-521717d219f7 could not be found. {{(pid=108970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:53:43.340937 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO nova.api.openstack.requestlog [None req-8245107b-73e2-4420-94af-940266b267b1 tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "GET /compute/v2.1/servers/0e1ad5f4-a543-4d5f-bfcc-521717d219f7" status: 404 len: 111 microversion: 2.1 time: 0.027100 Aug 27 04:53:43.341448 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: [pid: 108970|app: 0|req: 767/1538] 10.222.0.53 () {58 vars in 1236 bytes} [Fri Aug 27 04:53:43 2021] GET /compute/v2.1/servers/0e1ad5f4-a543-4d5f-bfcc-521717d219f7 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:53:44.621738 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: DEBUG nova.api.openstack.wsgi [None req-7f7135bb-3a9b-44c1-b06d-3013acd6fd1f tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] Calling method '.version_select at 0x7f20785c4550>' {{(pid=108971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:53:44.643880 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO nova.api.openstack.requestlog [None req-7f7135bb-3a9b-44c1-b06d-3013acd6fd1f tempest-TestVolumeBootPattern-1910359294 tempest-TestVolumeBootPattern-1910359294-project] 10.222.0.53 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-725197301" status: 202 len: 0 microversion: 2.1 time: 0.025784 Aug 27 04:53:44.644524 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: [pid: 108971|app: 0|req: 772/1539] 10.222.0.53 () {58 vars in 1260 bytes} [Fri Aug 27 04:53:44 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-725197301 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:54:27.695286 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:54:27.695947 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: Fri Aug 27 04:54:27 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:55:59.415402 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:55:59.415921 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: Fri Aug 27 04:55:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:56:00.974615 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:56:00.975279 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: Fri Aug 27 04:56:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:56:19.566607 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:56:19.567218 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: Fri Aug 27 04:56:19 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:56:21.957347 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 27 04:56:21.957990 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: Fri Aug 27 04:56:21 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:56:39.366284 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:56:39.368416 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: Fri Aug 27 04:56:39 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:57:47.712541 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:57:47.713244 dv-cinder-804035-5-iscsi devstack@n-api.service[108971]: Fri Aug 27 04:57:47 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:59:19.433163 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:59:19.433701 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: Fri Aug 27 04:59:19 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:59:20.992532 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:59:20.993121 dv-cinder-804035-5-iscsi devstack@n-api.service[108970]: Fri Aug 27 04:59:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!